-- Logs begin at Tue 2022-08-23 22:38:41 UTC, end at Tue 2022-08-23 23:34:26 UTC. -- Aug 23 23:06:18.891226 dv-osbrick-853457-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 23 23:06:18.906925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 23:06:18 2022] *** Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: nodename: dv-osbrick-853457-3-iscsi Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: machine: x86_64 Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: clock source: unix Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: pcre jit disabled Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: detected number of CPU cores: 4 Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: current working directory: / Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: detected binary path: /usr/bin/uwsgi-core Aug 23 23:06:18.909630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: your processes number limit is 47680 Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: your memory page size is 4096 bytes Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: detected max file descriptor number: 2048 Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: lock engine: pthread robust mutexes Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: thunder lock: enabled Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 23 23:06:18.910437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 23:06:18.951506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: Python main interpreter initialized at 0x55e058bf09c0 Aug 23 23:06:18.951506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: python threads support enabled Aug 23 23:06:18.951506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: your server socket listen backlog is limited to 100 connections Aug 23 23:06:18.951506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: your mercy for graceful operations on workers is 90 seconds Aug 23 23:06:18.951932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 23:06:18.952013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: *** Operational MODE: preforking *** Aug 23 23:06:18.952248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: *** uWSGI is running in multiple interpreter mode *** Aug 23 23:06:18.952248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: spawned uWSGI master process (pid: 81569) Aug 23 23:06:18.952467 dv-osbrick-853457-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 23 23:06:18.953565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: spawned uWSGI worker 1 (pid: 81583, cores: 1) Aug 23 23:06:18.953565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: spawned uWSGI worker 2 (pid: 81584, cores: 1) Aug 23 23:06:18.953565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81569]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 23:06:23.402933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:06:23.402933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 23 23:06:23.403786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:06:23.403786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 23 23:06:23.404430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:06:23.404430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: from cryptography.utils import int_from_bytes Aug 23 23:06:23.404563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 23:06:23.404563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: from cryptography.utils import int_from_bytes Aug 23 23:06:23.455079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:06:23.455308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:06:23.455451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] command line args: [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:06:23.455671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 23:06:23.455775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:06:23.455895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 23:06:23.455988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ================================================================================ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:06:23.456096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] command line args: [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 23:06:23.456182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.456373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 23:06:23.456452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] config_dir = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.456557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ================================================================================ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 23:06:23.456643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.456755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] config_source = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.456837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.456941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] debug = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] config_dir = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] config_source = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] debug = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.457938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_config_append = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.458993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_dir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_config_append = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_dir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.459889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.460967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.461993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.462870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.463156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.463251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.463324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] publish_errors = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.463554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.463666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.464326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.464473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] publish_errors = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.464644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.464792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.464936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] standard_threads = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] standard_threads = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.465959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] use_journal = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] use_json = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] use_journal = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] use_stderr = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.466968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] use_json = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] use_syslog = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] use_stderr = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] use_syslog = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.467724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 23:06:23.467854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.468892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.469919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.470990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.471927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.472982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.473938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.474972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.475963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.476922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.477909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.478955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.479077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.479183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.479282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.479403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.479536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.480934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.481891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.482937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.483915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.484981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.485909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.486970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.487937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.488899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.489991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.490959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.491983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.492949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.external = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.external = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.493948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.password = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.password = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] auth.token = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] auth.token = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.494899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.495876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.496916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.497982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.498927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.499960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.500907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.501969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.502931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.503886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.504979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.505932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.506884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.507959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.508995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.509938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.510933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.511984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.512789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.513946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.514896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.515924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.516992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.517923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.518982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.519889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.520935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.521994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.522932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.523931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.524979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.525911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.526028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.526143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.526780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.526902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] role.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.527904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] role.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] role.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] role.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.528934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.529989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.530911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.531722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.532985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.533935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.534994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.535977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.536917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.537972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.538920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.539883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.540944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.541968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.542696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.542858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.543889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.544955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81584) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:06:23.545802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 23:06:23.545802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81583) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 23:06:23.573286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.573400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.573521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.573607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.573750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.573836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.582474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.582683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.613003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.613339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.613470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.613708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.673314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.673965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.723390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.723638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.725018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.725267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.885487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.886935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.887011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.887085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.887153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.887225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.911729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.912907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.913034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.913134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.913211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.925315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.925477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.938439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.938618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.938704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.938829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.938991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81583) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.939955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81584) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 23 23:06:23.957391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.957604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:06:23.957713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.957830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:06:23.957956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.958163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:06:23.958248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.958381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 23 23:06:23.958460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.958629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.958715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.958896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.959234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.959442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.959525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.959710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.969884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.970816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.977824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:23.977955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:23.980815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:23.981183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:23.981371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.981371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.981596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.981679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.981755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.981937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.982847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.983805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:23.984004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.006850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.007170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.008384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.008679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.008764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.008985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.014273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.014407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.014558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.014650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.014853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.014939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.021297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.021425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.021591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.021674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.025734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.025885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.026028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.026120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.026381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.027908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.028015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.028190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.028274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.028467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.046231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.046412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.046576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.046658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.050424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.050510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.053682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.053770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.053986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.054072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.058378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.058510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.061594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.061708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.064899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.065857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.066120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.066221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.066382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.066472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.083320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.083510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.083642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.083734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.083942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.084029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.084211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.084296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.091946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.092094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.093510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.093618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.093802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.094027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.096461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.096622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.096756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.096845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.097736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.109577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.109752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.109877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.109969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.110841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.111012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.111100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.111301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.111384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.127172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.127388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.130275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.130412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.133236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.133369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.134691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.134804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.136749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.136874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.137150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.137272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.137363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.137442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.143916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.144058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.145399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.145610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.148334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.148441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.148630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.148715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.148919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.149005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.149210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.149293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.157844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.158004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.158151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.158240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.158440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.158526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.165394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81584) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.165551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81583) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 23 23:06:24.165689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.165778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.165978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.166930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.167807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.168916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.169084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81583) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.169166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81584) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 23 23:06:24.204689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e058bf09c0 pid: 81584 (default app) Aug 23 23:06:24.204859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e058bf09c0 pid: 81583 (default app) Aug 23 23:06:24.208314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45d11-a122-43ee-905d-bc40a3de3c69 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:24.208609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45d11-a122-43ee-905d-bc40a3de3c69 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:24.208891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d45d11-a122-43ee-905d-bc40a3de3c69 None None] PATH_INFO: `/v3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:24.213151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Tue Aug 23 23:06:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:31.027213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:31.027778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:31.027894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:31.033401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:31.040582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:31.041075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:31.041160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:31.115253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: INFO dbcounter [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] Registered counter for database keystone Aug 23 23:06:31.136476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG oslo_db.sqlalchemy.engines [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81583) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:06:31.143068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writer thread running {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:06:31.330395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81583) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:06:31.330742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG passlib.handlers.bcrypt [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81583) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:06:31.387250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:31.388986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:31.527525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 23 23:06:31.997438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:32.067214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: INFO dbcounter [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] Registered counter for database keystone Aug 23 23:06:32.090544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG oslo_db.sqlalchemy.engines [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81584) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 23:06:32.097132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writer thread running {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 23:06:32.219334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941420f-c4a2-4537-860a-11f7f3796311 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:32.224144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:32.224811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:32.225096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:32.225375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:32.234554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:32.286785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:06:32.287039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bf7b96-ade3-4b3c-a171-50abeac0c34f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:32.297795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Aug 23 23:06:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 23:06:32.303931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:32.320204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c9b48-977b-4ed1-866f-8feec28607d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:32.325700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:32.326848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:32.327124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:32.327394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] PATH_INFO: `/v3/projects/d2adca37f0d3413e86c54f533079bbbf` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:32.329264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] RBAC: Authorizing `identity:get_project(project_id=d2adca37f0d3413e86c54f533079bbbf)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:32.381856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING keystone.common.rbac_enforcer.enforcer [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 23 23:06:32.382197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b66c11-638f-4c50-92d9-bbb08ca4350a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:32.387750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Tue Aug 23 23:06:32 2022] GET /identity/v3/projects/d2adca37f0d3413e86c54f533079bbbf => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:34.344968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87a99-063d-4397-a025-c651a3903352 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:34.345565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87a99-063d-4397-a025-c651a3903352 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:34.345565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f87a99-063d-4397-a025-c651a3903352 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:34.349743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:34.356267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:34.356758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:34.356847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:34.378084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:34.379641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:34.387972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 23 23:06:34.658085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87a99-063d-4397-a025-c651a3903352 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:34.671818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f87a99-063d-4397-a025-c651a3903352 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:34.676114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:34.676731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:34.677015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:34.677296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:34.686621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:34.688481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82542ff7-d341-49cd-acf0-3e1c089f8f29 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:34.697936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Aug 23 23:06:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:06:34.704477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:34.714071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa13a1-e674-4b52-a8c7-f22d071aa2df None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:34.718484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:34.719135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:34.719419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:34.719702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:34.721052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:34.723084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc690d4-3cd5-4f64-bf37-805b9f53e02b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:34.724712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Tue Aug 23 23:06:34 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:36.742827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc424d8d-d9fd-4223-8e7a-51e6abaeefc6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:36.743373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc424d8d-d9fd-4223-8e7a-51e6abaeefc6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:36.743373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc424d8d-d9fd-4223-8e7a-51e6abaeefc6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:36.744979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:36.751721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:36.752394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:36.752394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:36.782168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:36.783301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:36.791919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104fa2f-5fe3-4159-b6fa-5a607913af16 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:36.792373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104fa2f-5fe3-4159-b6fa-5a607913af16 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:36.792879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104fa2f-5fe3-4159-b6fa-5a607913af16 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:36.795295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:36.802593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:36.803039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:36.803385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:36.847300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81584) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 23 23:06:36.847740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG passlib.handlers.bcrypt [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81584) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 23 23:06:36.874535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:36.893678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:36.895296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:37.001324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:37.149309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.175468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.276375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f6db5-ed7a-42a8-934b-d62452769614 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.281764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.314377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.315220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.315509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.315819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.327688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:37.336560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:37.338240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:37.339977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:37.347478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.430998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1efee1-9af7-4784-a030-9c640c793521 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.436663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.474258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.478771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.480223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.480504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.480858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.494360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca179498-9597-4ad2-9087-7a7b2b61d5d7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.532831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.533430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.533717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.534000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.534684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:37.534992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:37.536512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:37.552228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:37.558929 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.562689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:37.564376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:37.669044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a4202-b3a1-4609-b91d-d33af0f4a67e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.682261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:06:37.688373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.691575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.707789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.708431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.708713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.708988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.710151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:37.711610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:37.713225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:37.719883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.735928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.804819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c7ea5-0797-4335-8a3d-b003087931c7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.837597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2758973-e577-4d0f-959b-7f4ccc18835b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:37.841905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.842786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.843074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.843354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.869245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:37.870835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:37.877500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:37.878145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:37.878424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:37.878701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:37.879863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:37.881320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:37.882880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 10/18] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:37.889164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:06:37.890305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:37.891940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:06:37.893342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:06:37.893342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:06:37.893342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:37.893342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 9/19] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:06:37.897842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:37.960120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:37.980177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:38.003342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a90f3-92bf-4cad-a7db-2a0a05347913 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:38.006650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce7d71-3ed5-44fd-8d7d-f601031a55d9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:38.042682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:38.043347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:38.043636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:38.043876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:38.044093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:38.044498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:38.044781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:38.044933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.domain.id=default, user.id=e0ca15452b034174ab0e683ef8b23043) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:38.045086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:38.045253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:38.045688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:38.045991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:38.046722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55578cf6-c63c-4eb5-9cb0-5c8fc3e1a25e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:38.047367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d87fec-1c32-4302-a4e3-6e13f9273a4f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:38.053803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 11/20] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/role_assignments?user.id=e0ca15452b034174ab0e683ef8b23043&scope.domain.id=default&role.id=fa42eaf240474f4086e94c0d56757850 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:38.066850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 10/21] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:40.527335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a02d-511c-4f0e-9866-d5c589e10227 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:40.528214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a02d-511c-4f0e-9866-d5c589e10227 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:40.528214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16a02d-511c-4f0e-9866-d5c589e10227 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:40.529271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 12/22] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:40.542887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da641-d790-41fa-a554-556f51ba27a2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:40.543416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da641-d790-41fa-a554-556f51ba27a2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:40.543416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9da641-d790-41fa-a554-556f51ba27a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:40.581282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5b9da641-d790-41fa-a554-556f51ba27a2 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:40.582522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5b9da641-d790-41fa-a554-556f51ba27a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:40.674900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 11/23] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:40.684397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192ab-917e-4183-a9f0-a244ff07eeb0 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:40.684706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192ab-917e-4183-a9f0-a244ff07eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:40.684963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b192ab-917e-4183-a9f0-a244ff07eeb0 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:40.686456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 13/24] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:40.700212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e5d3-10a4-461f-a361-c4c9c4a6f23c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:40.700543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e5d3-10a4-461f-a361-c4c9c4a6f23c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:40.700794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2e5d3-10a4-461f-a361-c4c9c4a6f23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:40.728104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3af2e5d3-10a4-461f-a361-c4c9c4a6f23c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:40.729918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3af2e5d3-10a4-461f-a361-c4c9c4a6f23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:40.802518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:40.847112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 12/25] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:41.080888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e353b-6b18-4e72-a588-4e84c46a28de None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.081125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e353b-6b18-4e72-a588-4e84c46a28de None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.081503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e353b-6b18-4e72-a588-4e84c46a28de None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.082784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 14/26] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:06:41.091370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.091952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.092407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.129377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:41.131300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:41.237178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 13/27] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:41.289860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e353b-6b18-4e72-a588-4e84c46a28de None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:41.370737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:41.455106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e353b-6b18-4e72-a588-4e84c46a28de None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:41.493503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:41.497020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.497303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.497578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.524123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:41.526991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:41.541539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-52bfb544-2e06-4ebf-aadd-ebe22a44670b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:06:41.567002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:41.567963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:06:41.568790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:06:41.568790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:06:41.568790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:41.568790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 15/28] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:41.572421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc8cf-8d77-4f60-8607-c829f605f45d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.572421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc8cf-8d77-4f60-8607-c829f605f45d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.572421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc8cf-8d77-4f60-8607-c829f605f45d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.574977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 16/29] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:41.583918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc8cf-8d77-4f60-8607-c829f605f45d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:41.605300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755812a-555d-40f9-8fcb-636e1595b18b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:41.614743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:41.665969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:41.666540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.666874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.667230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.681899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c2a44cd2-49b5-4a0b-b276-5564786e4ecb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:41.689850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:41.690769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:41.691536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:41.694359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 14/30] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:06:41.695985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.696589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.697071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.718219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:41.719913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:41.747286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc8cf-8d77-4f60-8607-c829f605f45d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:41.798900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:41.800410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:41.800889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:41.801552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:41.802949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:41.804023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:41.807352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:41.809632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 15/31] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:41.810826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:41.854828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 17/32] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:41.856238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:41.989407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:42.009741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:42.023029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4e315-0a99-4d10-befb-86eec7017b78 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.067857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467c0a9-0f59-4ca1-8a41-1dfebcd8798d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.074723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.075496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.076523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.076939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.077735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.080244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b2fe4-6176-49d0-9b7a-acced75e05b5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.111006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.111642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.111957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.112240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.112923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:42.113233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.114630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.130149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 18/33] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:42.130149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.223888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 16/34] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 23 23:06:41 2022] POST /identity/v3/roles => generated 225 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:42.225404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b8c8-661f-4670-afc5-4095d9835e31 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.225700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b8c8-661f-4670-afc5-4095d9835e31 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.225983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88b8c8-661f-4670-afc5-4095d9835e31 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.227548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 17/35] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:42.228521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1569f-d18c-4ed5-8dd8-a49c1243792d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.228815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1569f-d18c-4ed5-8dd8-a49c1243792d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.229979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1569f-d18c-4ed5-8dd8-a49c1243792d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.231526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 18/36] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:42.236986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1569f-d18c-4ed5-8dd8-a49c1243792d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.279700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb700aa6-82ef-46a2-a6fd-68398de7c0a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.314058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:42.336506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.337202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.337487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.337810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.338539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.341261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63bb77d-f5c4-48df-b8f5-0226881ad36b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.404312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1569f-d18c-4ed5-8dd8-a49c1243792d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.456338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.457359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.457819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.458269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.460613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.462233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.464653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 19/37] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:42 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:42.465344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.492364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 19/38] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:06:42 2022] POST /identity/v3/projects => generated 301 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:42.503852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4531ad-8a15-462a-aea4-fe29f54112fd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.503852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4531ad-8a15-462a-aea4-fe29f54112fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.503852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4531ad-8a15-462a-aea4-fe29f54112fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.504735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:42.528759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8e4531ad-8a15-462a-aea4-fe29f54112fd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:42.531347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8e4531ad-8a15-462a-aea4-fe29f54112fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:42.614650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764aa190-4eaa-44c1-ae89-dbf6693d9f90 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.624312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 20/39] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:42.626573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.627018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.627444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.653961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:42.655385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:42.667036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.667668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.668065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.668354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.669047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.670516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.697548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 20/40] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 23 23:06:42 2022] POST /identity/v3/roles => generated 219 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:42.698960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.770421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 21/41] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:42.833379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:42.853769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef85a97-fee4-4007-8e26-60e9adb3bdc6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:42.895535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:42.896813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:42.896813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:42.896813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:42.898037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:42.899509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:42.901926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 21/42] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:42.907781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.958993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:42.967472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:43.054292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4f54a3-e7f8-4ef6-a0bd-2d6a793115e8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:43.088518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa93402-3ba0-4d32-892c-65ca1fc22831 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:43.106082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:43.106763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:43.107041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:43.107314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] PATH_INFO: `/v3/domains/default/users/e0ca15452b034174ab0e683ef8b23043/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:43.109432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=e0ca15452b034174ab0e683ef8b23043, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:43.111184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:43.126477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 22/43] 10.222.0.70 () {58 vars in 1361 bytes} [Tue Aug 23 23:06:42 2022] PUT /identity/v3/domains/default/users/e0ca15452b034174ab0e683ef8b23043/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:06:43.127340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:43.134648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:43.135324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:43.136297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:43.136588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:43.137887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:43.139557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:43.141724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 22/44] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:43.148230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:43.177356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:43.274610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:43.299020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1bd09f-f8ad-4ac4-8a7e-6de8cbf08c26 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:43.300336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b615a3-7b58-44e6-b95b-da92dadadc1b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:43.350259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:43.350955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:43.351360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:43.351708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:43.351820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:43.352433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:43.352532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:43.352718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:43.352994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:43.353664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:43.355367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145f00f-3d37-4004-89b4-5b6f5cc80851 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:43.356010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f792e-be91-43c8-84bf-c67da5578788 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:43.374860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 23/45] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 23 23:06:43 2022] POST /identity/v3/roles => generated 223 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:43.509186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 23/46] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:06:43 2022] POST /identity/v3/projects => generated 312 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:06:45.097848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828018-8b83-4935-8480-248a8b5e5625 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.098381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828018-8b83-4935-8480-248a8b5e5625 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.098498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c828018-8b83-4935-8480-248a8b5e5625 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.099946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 24/47] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:45.106120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da579a-7d8e-4819-ad86-677586a3005d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.106583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da579a-7d8e-4819-ad86-677586a3005d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.106666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da579a-7d8e-4819-ad86-677586a3005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.126279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-87da579a-7d8e-4819-ad86-677586a3005d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:45.127854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-87da579a-7d8e-4819-ad86-677586a3005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:45.206506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 24/48] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:45.476534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c828018-8b83-4935-8480-248a8b5e5625 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:45.484107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8426-2134-42d5-a1cf-84cb14c28afc None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.484405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8426-2134-42d5-a1cf-84cb14c28afc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.484689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd8426-2134-42d5-a1cf-84cb14c28afc None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.486088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 25/49] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:06:45.491499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.491816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.492100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.508378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:45.524694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:45.525916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:45.605522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 26/50] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:45.707642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c828018-8b83-4935-8480-248a8b5e5625 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:45.744935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:45.745563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.745842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.746120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.757119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:45.762498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:45.763577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:45.765130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 25/51] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:45.769752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:45.876596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:45.886308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f730d0-6977-4dd4-a5d9-e010d9819172 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:45.890179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:45.918580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:45.925541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:45.926242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:45.926607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:45.926902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:45.927939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:45.928275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:45.929994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:45.945108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 27/52] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:45.955466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:45.996264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d607f7b-779c-4ebb-a11a-fcb8d8d2a3d5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:46.035873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:46.036528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:46.036815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:46.037096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:46.038235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:46.039712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:46.041341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 26/53] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:46.047690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:46.071736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad0f89-059c-4ec8-957a-cbfcc1d710f4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:46.109226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a65b2-6943-402b-874e-732379387005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:46.110043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a65b2-6943-402b-874e-732379387005 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:46.110323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a65b2-6943-402b-874e-732379387005 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:46.110605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a65b2-6943-402b-874e-732379387005 None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:46.111857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a65b2-6943-402b-874e-732379387005 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:46.113358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a65b2-6943-402b-874e-732379387005 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:46.119651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 28/54] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:45 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:46.121135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a65b2-6943-402b-874e-732379387005 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:46.137629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:46.161157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b85ee0-52a8-4ea9-afd5-1335e7ba4778 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:46.196011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:46.209779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:46.210405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:46.210694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:46.210979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:46.211645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:46.213180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:46.251911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 27/55] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Aug 23 23:06:46 2022] POST /identity/v3/projects => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:06:46.252164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a65b2-6943-402b-874e-732379387005 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:46.299849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:46.300520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:46.300817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:46.301099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:46.302408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:46.303953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d620b39f-7f49-4daa-855f-8d9b269e63ca None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:46.305713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 29/56] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:46.315766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:46.433946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c5f6c-090d-4877-9385-e1329e745093 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:46.466500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:46.473335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:46.474362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:46.474950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:46.475577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:46.476365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.domain.id=default, user.id=e0ca15452b034174ab0e683ef8b23043) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:46.476686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:46.478195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c48203-abe4-49f3-afc0-cd8ea207ec22 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:46.485535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 28/57] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Aug 23 23:06:46 2022] GET /identity/v3/role_assignments?user.id=e0ca15452b034174ab0e683ef8b23043&scope.domain.id=default&role.id=fa42eaf240474f4086e94c0d56757850 => generated 530 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:48.221557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b7d6-ba20-40b7-8282-a7176f559d5d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:48.222085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b7d6-ba20-40b7-8282-a7176f559d5d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:48.222085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9b7d6-ba20-40b7-8282-a7176f559d5d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:48.223489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 30/58] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:48.229049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:48.229532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:48.229644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:48.253301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:48.254547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:48.335901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 29/59] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:48.615235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b7d6-ba20-40b7-8282-a7176f559d5d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:48.721586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9b7d6-ba20-40b7-8282-a7176f559d5d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:48.754390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:48.760811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:48.761705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:48.761990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:48.762262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:48.763392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:48.764879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e5282-048f-456a-9da0-ae46bfb3a27d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:48.766456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 31/60] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:48.772192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:48.892936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341a0c3d-5171-4a6a-ba0b-f0b9617a51e4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:48.919000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:48.931258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:48.931933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:48.932225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:48.932540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:48.933380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:48.934867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ab576e-79d4-4072-813b-4db8154bc20f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:48.962873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 30/61] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:06:48 2022] POST /identity/v3/users => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:52.280353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82591-db7a-4869-9b10-74242122ea62 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.280353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82591-db7a-4869-9b10-74242122ea62 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.280353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a82591-db7a-4869-9b10-74242122ea62 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.280353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 32/62] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:52.286206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58477-d58f-46ee-b1b1-bd8a6d6b2648 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.286645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58477-d58f-46ee-b1b1-bd8a6d6b2648 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.286836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a58477-d58f-46ee-b1b1-bd8a6d6b2648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.310777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-92a58477-d58f-46ee-b1b1-bd8a6d6b2648 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:52.312037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-92a58477-d58f-46ee-b1b1-bd8a6d6b2648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:52.418256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 31/63] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:52.456849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b16b-3936-4cb3-add9-f523e86c11c6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.457480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b16b-3936-4cb3-add9-f523e86c11c6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.457962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c67b16b-3936-4cb3-add9-f523e86c11c6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.459588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 33/64] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:52.465524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb158-4647-4251-8a89-596c31761099 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.465857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb158-4647-4251-8a89-596c31761099 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.466101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636bb158-4647-4251-8a89-596c31761099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.494036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-636bb158-4647-4251-8a89-596c31761099 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:52.495866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-636bb158-4647-4251-8a89-596c31761099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:52.610300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 32/65] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:52.749147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5b7d-dfcd-492d-9a78-a7d7ba92fc61 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.749783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5b7d-dfcd-492d-9a78-a7d7ba92fc61 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.750536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5b7d-dfcd-492d-9a78-a7d7ba92fc61 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.752151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 34/66] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:52.753742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb158-4647-4251-8a89-596c31761099 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:52.758120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.758703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.759179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:52.780039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:52.781619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:52.835489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:52.930301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 35/67] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:52.953302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636bb158-4647-4251-8a89-596c31761099 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:52.996145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:52.997193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:52.997681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:52.998161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.004833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.011680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:53.017687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:53.018672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:53.019442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:53.022001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 33/68] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:53.029536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.157614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026aac7-9e7c-4306-9145-f760716e4e33 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.181893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:53.206242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.207263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.207773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.208272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.209159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:53.209721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:53.211355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:53.222266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 34/69] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:53.229090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.231654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68170494-75ab-4b5f-9eb2-f94073a3ec94 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.288690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:53.303072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.304582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.305173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.306193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.327572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b856b20a-397b-4901-b7db-48d830bd4b09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:53.333099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:53.334131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:53.335041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:53.337005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 36/70] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:06:53.339561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006a8f-61f0-4fc3-8c67-18eb03716071 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.340039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006a8f-61f0-4fc3-8c67-18eb03716071 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.340459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca006a8f-61f0-4fc3-8c67-18eb03716071 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.342243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 37/71] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:53.343369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006a8f-61f0-4fc3-8c67-18eb03716071 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.370595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a5b86-0e72-404c-87ab-fa742ce56648 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.419726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.420311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.420648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.420889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.437021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:53.438589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:53.440361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 35/72] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:53.441154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.468813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:53.479447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca006a8f-61f0-4fc3-8c67-18eb03716071 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.520095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.520861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.521144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.521421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.533991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8493e1d6-8097-4dbe-aff7-0800fa972f4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:53.539301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:53.540295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:53.541082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 38/73] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:53.550348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.550677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.550910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.563920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808bf7df-2b3f-4d29-92cf-776fde750ea8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.575447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:53.576824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:53.611178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.615550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.615550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.615550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.615550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:53.615550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:53.617248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:53.633853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 36/74] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:53.634038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:53.634208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.675028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 39/75] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:53.676168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.764768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:53.792148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644a04f4-8e3c-457f-aab5-ec4f2b69310f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.815017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c8bba8-9c2c-4818-8f1c-f7d50c15d4fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:53.838840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.839671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.840005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.840290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.854780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:53.855401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:53.855810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:53.856095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:53.856776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:53.857080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:53.858476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:53.873652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 40/76] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:53.873652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:53.928184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:53.929612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818ff4c-35b0-4b16-8291-dc7b0d44d471 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:53.933995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.013050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2293f-4925-415e-91fa-d6fcf0af42c0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.022976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.043670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 37/77] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:06:54.045100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14786a-9973-4693-bc3b-371034c4da11 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.045396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14786a-9973-4693-bc3b-371034c4da11 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.045679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14786a-9973-4693-bc3b-371034c4da11 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.047012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 38/78] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:54.047746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14786a-9973-4693-bc3b-371034c4da11 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.061827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.062845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.063351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.063873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.065792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.068364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.076566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 41/79] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:53 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:54.076566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.170420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14786a-9973-4693-bc3b-371034c4da11 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.199157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b40523-9170-4c7b-9320-3268f66be46f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.209857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.210508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.210795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.211076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.212292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.213914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.214170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.221898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 39/80] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:54.221898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.248175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.248829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.249203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.249502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.261592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-687b48fa-2906-4aa4-beb2-dd1834d25425 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:54.266917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:54.267911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:54.268702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 42/81] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:54.269407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.269700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.269976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.277884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.289556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:54.290778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:54.338205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2c084a-475a-4004-a600-3b77844e1b86 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.371964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 43/82] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:54.372705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.391558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.392314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.392606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.392887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.394059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.395543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.397250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 40/83] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:54.398038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.515200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ae742-640e-4afd-9768-f86cfb8968e3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.516717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.521100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a8df22-5238-4292-9fea-4f65104342e7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.544668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.562706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95213e-905d-441f-9740-168e8327890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.563343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95213e-905d-441f-9740-168e8327890b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.563654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95213e-905d-441f-9740-168e8327890b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.563959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95213e-905d-441f-9740-168e8327890b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.574174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.574860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.575144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.575428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.653922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95213e-905d-441f-9740-168e8327890b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.655874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95213e-905d-441f-9740-168e8327890b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.663256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.665108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.762057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.767254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 44/84] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:06:54.768167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95213e-905d-441f-9740-168e8327890b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.778564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 41/85] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:06:54.779361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.800593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:54.888425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95213e-905d-441f-9740-168e8327890b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.892500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575aa9e7-17f6-4324-94a9-3b2b2d204a37 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:54.924921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.925665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.926001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.926350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.927105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:54.927486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.929044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.937956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 45/86] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:54.939012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:54.939801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:54.940438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:54.940737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:54.941016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:54.941766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:54.942086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:54.943641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:54.949858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 42/87] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:54.950693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.024053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.068568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.078172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15b2d-26ce-476a-946e-160b48de562a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.096607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7733185-5ff0-4819-9530-541a24a0f015 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.128427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.129092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.129476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.129723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.130948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.132889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.139807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 46/88] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.139807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.141393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.142054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.142350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.142629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.143818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.145295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.147128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 43/89] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:54 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.152909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.269341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc810e8-045d-4763-900d-a1b42b06a00e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.281131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdde099-e9c3-47db-ac6e-619c75051ca1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.297717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.309338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.310232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.310658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.311076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.312413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.314070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.316287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 47/90] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:55 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.317299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.340141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.340918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.341208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.341493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.342763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.344315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.347872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 44/91] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:55 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.347872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.370310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.477644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22586194-7dcb-4fb6-84ca-b60f665b0a79 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.478002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b9106-7c65-4098-9af7-7ab97719e444 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.515494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.516509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.516749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.517036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.517785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=e0ca15452b034174ab0e683ef8b23043) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:55.518103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.518948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.519575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.519669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.519908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.520192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.520853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.527142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.527361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 45/92] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:06:55 2022] GET /identity/v3/role_assignments?user.id=e0ca15452b034174ab0e683ef8b23043&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.527361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.576685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 48/93] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:06:55 2022] POST /identity/v3/users => generated 289 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:06:55.580846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:55.710924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.721348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:55.752478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d82de-841c-4704-9417-141cb35601b5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.804130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c5faf-72fa-4a9a-994e-a040a381dbd1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:55.814796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.816513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.818621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.818923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.819711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:55.820115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.821602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:55.831618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 46/94] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:06:55 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=6cc679021d904431823a4fe019f8ddcb => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:55.868189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:55.868832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:55.869114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:55.869390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:55.989985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:55.991500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:56.072886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:56.137166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 49/95] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:06:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:06:56.144269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:56.294889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281477e-a213-4cb9-a69c-51280b80dfd8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:56.342714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:56.343374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:56.344928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:56.345216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] PATH_INFO: `/v3/projects/fe920899ce7c49758cd8418e65a6cb10` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:56.346431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] RBAC: Authorizing `identity:get_project(project_id=fe920899ce7c49758cd8418e65a6cb10)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:56.347932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca963803-010b-43b4-af53-443fac2eb927 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:56.349658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 47/96] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:56 2022] GET /identity/v3/projects/fe920899ce7c49758cd8418e65a6cb10 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:56.357884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:56.487632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de93b784-4265-4799-a4d6-5b1bf1e686b1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:56.531383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:56.532402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:56.532916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:56.533392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:56.534339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=fe920899ce7c49758cd8418e65a6cb10, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:56.534856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:56.536565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8f7288-29b2-4f60-93b8-7cb853bec9fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:56.550865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 50/97] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:06:56 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=fe920899ce7c49758cd8418e65a6cb10&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:57.330606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbec3-f7d8-4053-b394-930c06bc7d04 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:57.331125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbec3-f7d8-4053-b394-930c06bc7d04 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:57.331233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fbec3-f7d8-4053-b394-930c06bc7d04 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:57.332964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 48/98] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:57.339298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555bb2-7175-4fb5-813d-4a161348ca70 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:57.339985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555bb2-7175-4fb5-813d-4a161348ca70 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:57.340661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555bb2-7175-4fb5-813d-4a161348ca70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:57.374519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-89555bb2-7175-4fb5-813d-4a161348ca70 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:57.376811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-89555bb2-7175-4fb5-813d-4a161348ca70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:57.389187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:57.474814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 51/99] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:58.064322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fbec3-f7d8-4053-b394-930c06bc7d04 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:58.083288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:58.129296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03fae0-f210-4821-b8e1-59b59ff6a42b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.129602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03fae0-f210-4821-b8e1-59b59ff6a42b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.129857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03fae0-f210-4821-b8e1-59b59ff6a42b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.131376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 52/100] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:06:58.140775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.141146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.141332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.170398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:58.172027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:58.254849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fbec3-f7d8-4053-b394-930c06bc7d04 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:58.319076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:58.324042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.324042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.324042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.329987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 53/101] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:58.359604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:58.364505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:58.365392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:58.366281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 49/102] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:58.373605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:58.490295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:58.524475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c82b6b-2dc1-4dcf-b267-6904673c9cde None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:58.575740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:58.576406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.576701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.576977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.577668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:58.577980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:58.579393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:58.588631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 54/103] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:06:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:58.600919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:58.729762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:58.768919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f917c-cdd3-4811-9d4d-00aa2ca93d6f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:58.807138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:58.807903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.808187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.808471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.809721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:58.811225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb76f44-3511-487d-acd1-cfbe27f685c1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:58.813146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 50/104] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:58 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:58.819193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:58.831711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6db65-0ccc-4cca-b4e7-db24ad413300 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.832615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6db65-0ccc-4cca-b4e7-db24ad413300 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.833386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6db65-0ccc-4cca-b4e7-db24ad413300 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.836061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 51/105] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:06:58.845633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:58.846493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:58.847181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:58.898953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:58.900728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:58.993139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774361b-9d32-48c1-b0ef-5b971e4d1185 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.036446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 52/106] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:59.039415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.075097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.075786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.076080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.076368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.079141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:59.080667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:59.082467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 55/107] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:58 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:59.091780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.108360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.176387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.210507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc9acf9-5d45-49ea-8d18-0b9db828672d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.240057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caba472-be38-4c22-b547-59ad7fe4e228 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.249659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.250673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.250962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.251245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.264261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:59.269538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:59.270420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:06:59.271192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 53/108] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:59.279511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.281035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.281746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.282471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.282751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/c25a5203124948e589990b29322fd97b/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.288642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, user_id=c25a5203124948e589990b29322fd97b, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:59.290274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876b6ba-69f0-4737-bb28-d784cd3acd42 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:59.318393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 56/109] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:06:59 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/c25a5203124948e589990b29322fd97b/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:06:59.403443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c7630-5bfb-4a7a-8040-ccca7046af64 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.443460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.453582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.454627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.455103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.455575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.456815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:06:59.457310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:59.459122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:59.460128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef93e4-6613-43fe-9e43-36572b1db7c6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.460420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef93e4-6613-43fe-9e43-36572b1db7c6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.460858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef93e4-6613-43fe-9e43-36572b1db7c6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.462479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 57/110] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:06:59.469789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 54/111] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:59.473658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.473939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.474224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.505753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.516985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:59.523331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:59.615149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.628695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 58/112] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:06:59.629822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.686807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49fcffd-18ab-481a-b096-25a9460278d8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.723635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.724388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.724736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.725012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.726166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:59.727691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a6601f-a6ba-43de-b367-b26d95f91fb8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:59.729427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 55/113] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:06:59.735513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547027e-fbd8-4fde-80bb-1bbc6a1706fe None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.735866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547027e-fbd8-4fde-80bb-1bbc6a1706fe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.736108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547027e-fbd8-4fde-80bb-1bbc6a1706fe None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.737505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 56/114] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:59.738390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547027e-fbd8-4fde-80bb-1bbc6a1706fe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.799437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f911f34-5921-4258-9c35-e5119c01de4d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.812095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.853068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.853724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.854012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.854967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.858922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547027e-fbd8-4fde-80bb-1bbc6a1706fe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:06:59.868896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-32c3a483-14c5-4292-bacb-aa26c83e284a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:06:59.879023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:06:59.880450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:06:59.881877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:06:59.896140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 59/115] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:06:59.896140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.896140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.896140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.902789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:06:59.903663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.904092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.904478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.905894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:06:59.907560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646ca7d-90f4-4656-b4a6-903b8be8b5bb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:06:59.908765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:06:59.909750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 57/116] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:06:59.910015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:06:59.911263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd001-9f21-46a6-b990-ea6c2cec4617 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:06:59.911778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd001-9f21-46a6-b990-ea6c2cec4617 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:06:59.912195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd001-9f21-46a6-b990-ea6c2cec4617 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:06:59.913794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 58/117] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:06:59.914657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd001-9f21-46a6-b990-ea6c2cec4617 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:06:59.971105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:06:59.992003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 60/118] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:06:59.992673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.066765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd001-9f21-46a6-b990-ea6c2cec4617 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.103795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:00.111870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.112501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.112784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.113113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.113848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:00.114159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.116037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c5b34-78d0-4a9c-a86b-9bd2b108459c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.135390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 59/119] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:06:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:00.135390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.135390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.135390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.155530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac4719-0488-4455-8121-a21bbc210c28 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.155716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:00.156788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:00.201093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.202274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.202757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.203264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/e0ca15452b034174ab0e683ef8b23043/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.206682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, user_id=e0ca15452b034174ab0e683ef8b23043, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.208456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.232184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 61/120] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:06:59 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/e0ca15452b034174ab0e683ef8b23043/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:00.233526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.254185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 60/121] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:00.254831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.371089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:00.388947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054964da-fc8e-4981-83c6-574eb3f2c595 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.417551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:00.431888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.432659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.432865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.433209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.434529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.436057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.437928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 61/122] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:00.438630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.497462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00477f73-33d2-47ef-a4a8-7b2e5a502265 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.544396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.545557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.545995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.546295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.561406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:00.564222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c759454-259e-4438-b513-1ddc2419c83c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:00.567393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:00.568323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:00.569092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 62/123] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:00.570332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.616560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.617888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.618342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.618784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.621719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.624608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.628361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 62/124] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:00.629018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.702559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b10a8-0a99-4d0c-8544-821c12902c2d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.711348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:00.724136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:00.750591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.752297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.752989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.753668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.755397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.757165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.759012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 63/125] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:00.759969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.772082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800491cf-cf29-4b12-a97b-63e5dde7feea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.820001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.820389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.820676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.820961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.833275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:00.838196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:00.839611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:00.840416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 63/126] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:00.841047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.908197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39884a3d-4cf3-4605-8e16-415c929e1c90 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:00.953900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:00.954541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:00.954817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:00.955091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:00.955799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:00.956116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:00.957887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:00.975829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 64/127] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:00.975829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:00.980478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47137f23-1e0f-446f-8d70-c504ac527203 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.012319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:01.021137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.021917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.022357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.022748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.023582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.025243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.027791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:01.067788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 64/128] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:07:00 2022] POST /identity/v3/projects => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:01.067788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.159219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491eb14d-8833-4fce-b11e-cfcaae8f4d2b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.192453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b02450b-9cbc-4370-9762-59744702d37f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.223582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.224540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.224999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.225423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/c25a5203124948e589990b29322fd97b/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.233858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, user_id=c25a5203124948e589990b29322fd97b, role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.235999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.248755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.250027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.250678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.251111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.252189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:01.252747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.259805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.266347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 65/129] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:00 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/c25a5203124948e589990b29322fd97b/roles/6cc679021d904431823a4fe019f8ddcb => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:01.266666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 65/130] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:01.268124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.281725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.312458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:01.417552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33871e4-194e-4479-8fed-9b9d2aca1524 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.464499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.465206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.465669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.466043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] PATH_INFO: `/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.484725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] RBAC: Authorizing `identity:get_user(user_id=8b4ec7f1a1a44310b06f2f2f2f1c43b3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.486465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.486865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:01.488804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 66/131] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:01 2022] GET /identity/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:01.495242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.502188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f5339-94f1-4900-ae02-f282758623b9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.577429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.578904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.579389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.579923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.584562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.586425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.590596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 66/132] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:01 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:01.595355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.638473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:01.652716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2004281-8a99-444e-8808-5fb0dae5106d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.696719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.697391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.697682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.698053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.747821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceaf8e3-aa0b-4430-9c7e-11b6beefd1cc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:01.828405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:01.830461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:01.831153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:01.832149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.832715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] PATH_INFO: `/v3/projects/fe920899ce7c49758cd8418e65a6cb10` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:01.834600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.837886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] RBAC: Authorizing `identity:get_project(project_id=fe920899ce7c49758cd8418e65a6cb10)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:01.840282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:01.842493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 67/133] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:01 2022] GET /identity/v3/projects/fe920899ce7c49758cd8418e65a6cb10 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:01.848220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:01.925696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:02.044128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:02.072306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 67/134] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:02.075218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b9581-cbf4-4c28-9502-aefacaf8779d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:02.097644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:02.123816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:02.123816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.123816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.123816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] PATH_INFO: `/v3/projects/fe920899ce7c49758cd8418e65a6cb10/users/c25a5203124948e589990b29322fd97b/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.124218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] RBAC: Authorizing `identity:create_grant(project_id=fe920899ce7c49758cd8418e65a6cb10, user_id=c25a5203124948e589990b29322fd97b, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:02.124674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37e918-c152-43f4-9b14-3ccc5cca329a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:02.153535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 68/135] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:01 2022] PUT /identity/v3/projects/fe920899ce7c49758cd8418e65a6cb10/users/c25a5203124948e589990b29322fd97b/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:07:02.176215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a242b7-c24d-4268-b171-a1f0dc06ae58 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.176687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a242b7-c24d-4268-b171-a1f0dc06ae58 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.177153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a242b7-c24d-4268-b171-a1f0dc06ae58 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.184119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 69/136] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:02.193999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.194294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.194778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.249942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:02.251495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:02.341791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75653c72-9f43-4624-99ad-fd7b4e68364f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:02.419061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:02.421341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.421818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.422283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.424553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:02.427163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:02.433672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 70/137] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:02.435360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 68/138] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:02 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:02.441247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:02.483402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:02.588278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e904652-4838-4c86-a1f8-2e6c81ee11da None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:02.631017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:02.631646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.631954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.632234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.632977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=8b4ec7f1a1a44310b06f2f2f2f1c43b3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:02.633288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:02.634835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cacf2-a3d3-462b-b6ce-9d1c3ebd4fc8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:02.644577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 71/139] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:02 2022] GET /identity/v3/role_assignments?user.id=8b4ec7f1a1a44310b06f2f2f2f1c43b3&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:02.837583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:02.929033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:02.983529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b69fef-39cf-47ee-8d32-43b62cba6aca None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.983894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b69fef-39cf-47ee-8d32-43b62cba6aca None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.984121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b69fef-39cf-47ee-8d32-43b62cba6aca None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:02.985878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 72/140] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:02.986898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10481303-bd96-4c96-b93f-7b3046bed3a0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:02.997835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:02.998158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:02.998386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:03.030116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:03.031353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:03.033505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:03.034176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:03.038229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:03.038229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:03.063300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:03.068164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:03.069221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:03.070141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 69/141] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:03.078516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:03.181207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 73/142] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:03.264619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dedc47-f4c4-4f95-9634-54c66272768b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:03.290318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:03.316963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:03.317591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:03.317872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:03.318145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:03.318825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:03.319130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:03.320555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:03.336490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 70/143] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:03.343601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:03.369138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:03.481263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a1210-81b2-4615-8277-182205238fc4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:03.525046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:03.526708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:03.527228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:03.527699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:03.529191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:03.530865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:03.532769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 74/144] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:03 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:03.538805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:03.688243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9d2ae-bb10-48f4-9825-37548ec700d2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:03.732183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:03.732721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:03.733003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:03.733272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:03.808711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:03.810012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:03.842998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:03.844536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:04.003908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:04.039357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f14898-b83c-4782-b843-dcc6611d405a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.049758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 71/145] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:04.082841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:04.096067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.097058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.097535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.097990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.123931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:04.135934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:04.137337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:04.138132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:04.141022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 75/146] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:04.146895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:04.278419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafbe126-2eba-4662-b8e8-58cd267689b8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.333775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.334802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.335300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.335804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.337032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:04.337581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:04.349520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:04.357920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:04.382670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 76/147] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:04.390753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:04.405731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:04.411236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b54aa-05f8-472a-bf21-3b2431bad567 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.487225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.487891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.488172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.488447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.491024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:04.492518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc793c6-1a84-40a3-bb4e-d19643af8e27 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:04.494208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 72/148] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:04 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:04.495986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674fed-b07a-42bd-8d39-7acfe27b9832 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.496382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674fed-b07a-42bd-8d39-7acfe27b9832 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.496661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26674fed-b07a-42bd-8d39-7acfe27b9832 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.502264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 73/149] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:04.504084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674fed-b07a-42bd-8d39-7acfe27b9832 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:04.579058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec46b5-685c-404f-b95d-e28d47e62069 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.629374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.630802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.631547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.632053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] PATH_INFO: `/v3/users/e0ca15452b034174ab0e683ef8b23043` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.634184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] RBAC: Authorizing `identity:get_user(user_id=e0ca15452b034174ab0e683ef8b23043)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:04.637054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca58357-a478-485e-a19d-bd477df3ed87 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:04.639459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 77/150] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:04 2022] GET /identity/v3/users/e0ca15452b034174ab0e683ef8b23043 => generated 247 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:04.641725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870baaf-f763-463a-b2b0-0caefad35446 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.642289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870baaf-f763-463a-b2b0-0caefad35446 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.642944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870baaf-f763-463a-b2b0-0caefad35446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.659707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26674fed-b07a-42bd-8d39-7acfe27b9832 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.670021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4870baaf-f763-463a-b2b0-0caefad35446 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:04.672447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4870baaf-f763-463a-b2b0-0caefad35446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:04.703300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.704689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.705185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.706127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.707652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:04.708270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:04.710584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efc538-8ee7-4125-bcd5-36dc6d908a05 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:04.721510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 74/151] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:04 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:04.723588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68a31-4c37-4657-a3ee-57ce40b6abfe None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.724099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68a31-4c37-4657-a3ee-57ce40b6abfe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.724775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae68a31-4c37-4657-a3ee-57ce40b6abfe None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.726444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 75/152] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:04.735114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae68a31-4c37-4657-a3ee-57ce40b6abfe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:04.757658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:04.769475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 78/153] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:04.771442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.771910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.772333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:04.784823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:04.804041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:04.806421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:04.894865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae68a31-4c37-4657-a3ee-57ce40b6abfe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:04.913342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 79/154] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:04.937344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:04.937972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:04.938252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:04.938527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.033462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:05.036071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:05.057970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.165797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 76/155] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:05.171586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.247522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.323132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf0996-6c59-4031-bed9-35e4181f6e3b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:05.372848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:05.374037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.379093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.379637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.381177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:05.382843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:05.384845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 80/156] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:05.391128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.395975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.460243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140d7ec-6eed-4ea5-9926-74d9b028292d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:05.487389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.525266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:05.526461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.526751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.527174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.538816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:05.544654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:05.545757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:05.546625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 77/157] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:05.547282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.570786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7a5a9-3dce-4bc1-9074-7c9fbb741b78 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:05.607277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:05.608100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.608389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.608661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.609399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=e0ca15452b034174ab0e683ef8b23043) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:05.609710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:05.611174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c8a39-4263-4143-a45c-6ce6443918c0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:05.617377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 81/158] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/role_assignments?user.id=e0ca15452b034174ab0e683ef8b23043&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:05.618541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe41b8-2199-417e-a5a0-205a74c14247 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.618824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe41b8-2199-417e-a5a0-205a74c14247 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.619171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe41b8-2199-417e-a5a0-205a74c14247 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.621244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 82/159] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:05.622378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce457-2327-44ba-bcf1-ab6f02a33dd6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.622661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce457-2327-44ba-bcf1-ab6f02a33dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.623017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ce457-2327-44ba-bcf1-ab6f02a33dd6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.625056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 83/160] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:05.626093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce457-2327-44ba-bcf1-ab6f02a33dd6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.702073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96723ed1-4ff5-4f28-8556-1819682a3604 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:05.733755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.745079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:05.745868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.746242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.746543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.748747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:05.750574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22720c60-0c2d-4c24-85b1-551473516210 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:05.752520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 78/161] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:05.753772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.754062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.754339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.774579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:05.776781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:05.795342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ce457-2327-44ba-bcf1-ab6f02a33dd6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:05.829036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:05.850526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:05.851492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.851995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.852422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.853117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:05.853426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:05.855228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb532a0-1af9-44f7-8f1d-727db3e65fed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:05.865111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 84/162] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:05.867588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:05.867588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:05.867588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:05.869152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 79/163] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:05.869906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:05.894874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:05.896881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:05.980994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 85/164] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:05.981701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.020570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc602529-de16-4f98-a3aa-177e1ad15bd7 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.063597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.064852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.065322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.065923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.067116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:06.069107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:06.069244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.102027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 80/165] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:05 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:06.133614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f600ab6-ec74-4ead-bb6a-4a25c8c116d7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.180383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.181049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.181304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.181439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.181577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.183812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:06.185420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:06.187789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 86/166] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:05 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:06.194180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.217123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.306282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff290d6-4025-48d3-91ea-f4d7accccacb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.320500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0fc1b-6d42-4694-bc16-55fe1589edfd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.354532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.365608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.366006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.366114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.366295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.366512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.366915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.367344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.367783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.380073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:06.387352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:06.388532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 81/167] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:06.389488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.466484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:06.468828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:06.516924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.540941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31f0ba-6c75-45cb-8da0-d3a6cf929c98 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.588890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.589509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.589765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.590604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.605657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:06.610620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:06.611550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:06.612470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:06.613290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 82/168] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:06.614287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.635001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 87/169] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:06.637131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.678814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.773599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311748-ef5d-4198-a002-3d047e59d60a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.783054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eeb690-52e4-4ca1-98ec-fd446866aae0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:06.824025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.824934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.825495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.825970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.826854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:06.827270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:06.828828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:06.840777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 83/170] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:06.841972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:06.845064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:06.847505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:06.848221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:06.848891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:06.850260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:06.851053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:06.853280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:06.855841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:06.865581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 88/171] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:06.867030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.014979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53726791-ac39-4bdc-a544-eb9bf25ab3d2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.079019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:07.096259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.096980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.097190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.097467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.098768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.100273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.101968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 84/172] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:07.106286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.112530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1cd8c-600a-44ce-a87e-792bf3e2fa56 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.188102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.188756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.189043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.189320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] PATH_INFO: `/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.196586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] RBAC: Authorizing `identity:get_user(user_id=8b4ec7f1a1a44310b06f2f2f2f1c43b3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.198158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.200042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 89/173] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:06 2022] GET /identity/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3 => generated 289 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:07.200863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.237905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:07.269700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e69c5-c464-4c74-83df-d6cb659717ec None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.307181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.307706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.308022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.308377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] PATH_INFO: `/v3/users/c25a5203124948e589990b29322fd97b` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.309603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] RBAC: Authorizing `identity:get_user(user_id=c25a5203124948e589990b29322fd97b)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.311094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.317523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 85/174] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:07 2022] GET /identity/v3/users/c25a5203124948e589990b29322fd97b => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:07.318316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.396579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e1158-d10e-4103-9dc2-7311e6606e75 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.450649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.452095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.452595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.453090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.454049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:07.454568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.456496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.464889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 90/175] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:07 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=6cc679021d904431823a4fe019f8ddcb => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:07.466385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.492225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:07.591426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198d046a-d3dd-4b96-8ef7-ab5b57b9f90c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.634969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.636688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.637316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.638647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.709948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0e993-7d67-46bb-ae42-62abbacf88c5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:07.723443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.725955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.764185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:07.852288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 91/176] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:07.860062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.871348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:07.872432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:07.872900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:07.873375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:07.875208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:07.877914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:07.880578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 86/177] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:07 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 567 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:07.887576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:07.927367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:08.087645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fd61-0fa0-4c70-9444-28d7de805e64 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:08.098481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd24744-5c79-4e3c-b12e-00b213c64801 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:08.140357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:08.148789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:08.149537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.149831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.150109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3/roles/911df5e7fdbe47aeaaab529626805d92` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.152232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, user_id=8b4ec7f1a1a44310b06f2f2f2f1c43b3, role_id=911df5e7fdbe47aeaaab529626805d92)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:08.154143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:08.176065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 87/178] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:07 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3/roles/911df5e7fdbe47aeaaab529626805d92 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:08.191643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:08.192356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.192646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.192927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] PATH_INFO: `/v3/projects/fe920899ce7c49758cd8418e65a6cb10` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.194304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] RBAC: Authorizing `identity:get_project(project_id=fe920899ce7c49758cd8418e65a6cb10)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:08.195860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a99c69-a43d-4417-9491-07f28e094b88 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:08.198071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 92/179] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:07 2022] GET /identity/v3/projects/fe920899ce7c49758cd8418e65a6cb10 => generated 312 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:08.205460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:08.331332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:08.369665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafe249-aa97-4959-a721-0447e36772f7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:08.416342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:08.418600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.419088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.419548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.420459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=fe920899ce7c49758cd8418e65a6cb10, user.id=c25a5203124948e589990b29322fd97b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:08.420774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:08.422230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de3ae5-5e1b-4ff8-ae61-c2e09ded8e1c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:08.429060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 88/180] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:08 2022] GET /identity/v3/role_assignments?user.id=c25a5203124948e589990b29322fd97b&scope.project.id=fe920899ce7c49758cd8418e65a6cb10&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:08.736431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aeb4-48fa-4148-8223-c0a488017c4f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.737091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aeb4-48fa-4148-8223-c0a488017c4f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.737601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051aeb4-48fa-4148-8223-c0a488017c4f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.739186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 93/181] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:08.746375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780c5c-e2e2-431e-830d-51dddbc65157 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.746693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780c5c-e2e2-431e-830d-51dddbc65157 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.746942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d780c5c-e2e2-431e-830d-51dddbc65157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.771464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4d780c5c-e2e2-431e-830d-51dddbc65157 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:08.772899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4d780c5c-e2e2-431e-830d-51dddbc65157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:08.859933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 89/182] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:08.993095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d3289-386f-40ed-a756-83daecf77b62 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:08.993717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d3289-386f-40ed-a756-83daecf77b62 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:08.994221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d3289-386f-40ed-a756-83daecf77b62 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:08.996835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 94/183] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:09.003236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40bae-fcc0-43f1-8cf3-b842c09cbbd4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.003541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40bae-fcc0-43f1-8cf3-b842c09cbbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.003811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f40bae-fcc0-43f1-8cf3-b842c09cbbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.028457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-36f40bae-fcc0-43f1-8cf3-b842c09cbbd4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:09.029669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-36f40bae-fcc0-43f1-8cf3-b842c09cbbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:09.106363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:09.117893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 90/184] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:09.172051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d3289-386f-40ed-a756-83daecf77b62 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.196647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc736f9-eb96-4b8a-9835-6a084b17ba6b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.197083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc736f9-eb96-4b8a-9835-6a084b17ba6b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.197239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc736f9-eb96-4b8a-9835-6a084b17ba6b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.199890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 91/185] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:09.204852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.205143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.205409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.225068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:09.226275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:09.301461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d3289-386f-40ed-a756-83daecf77b62 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.316192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 92/186] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:09.355602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.356652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.357199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.357710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.376189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:09.386765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:09.388368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:09.389978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:09.393615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 95/187] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:09.401550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.462788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.517727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1fa4c6-86be-4676-93c4-4097a90cf27d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.524313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:09.554039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:09.572291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.573958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.574533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.575016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.575981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:09.576370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:09.577974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:09.583940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3ebd7-34d0-4d53-9e57-0cc2bc70234c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.587525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 93/188] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:09.594205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.623808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.624911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.625364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.626063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.639255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:09.645635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:09.646592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:09.647483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:09.650126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 96/189] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:09.657654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.709180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0184c165-50b6-4aa8-b9eb-c213136edd4d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.746874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.747805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.748100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.748384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.764821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:09.766307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:09.768082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 94/190] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:09.768879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.793514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f5da-829d-410e-9f19-9568c18bd29e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.804395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:09.828354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:09.836030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.836735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.837089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.837450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.838200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:09.839305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:09.840852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:09.860241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 97/191] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:09.860241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.895467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d5eb6-e5e4-432a-b419-9404949ffb4f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:09.935520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:09.936340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:09.936503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:09.936773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:09.937934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:09.939392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:09.941222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 95/192] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:09.946374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:09.990259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd6a47-668f-47f5-b418-ac0a3a854d94 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.040140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.040850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.041130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.041661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.062231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edefb23-835e-484e-8b6a-22d014106c45 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.078258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.086519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.106155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.106805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.107342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.107342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.108622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.110138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.111683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 96/193] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:10.116570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:10.125039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.126810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.238644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae34ba-7028-4ae5-9293-b7947f7caf51 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.247921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 98/194] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:10.248822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:10.292198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.293198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.293653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.294034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.295147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.297389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.335956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 97/195] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:10 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:10.335956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:10.371185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.409949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.420567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1965f-5c69-4d2e-850f-4c82702593e7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.463663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.464995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.465752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.466298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.519701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744ecb5-a3a8-4117-b90c-5a6c5acff95f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.556702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.559521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b5f64-a13d-4cf1-92a8-7a66d464c553 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.565207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.565865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.566152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.566430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.572144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.572144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229c41d-27c9-47a3-9aa7-7bb6b2fa972c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.572386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 98/196] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:10 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:10.578061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec474315-933d-4d3f-9a59-275089ff428a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.578061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec474315-933d-4d3f-9a59-275089ff428a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.578061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec474315-933d-4d3f-9a59-275089ff428a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.578061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 99/197] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:10.580337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec474315-933d-4d3f-9a59-275089ff428a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:10.642813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.685033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 99/198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:10.689756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.689756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.689756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.708458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:10.709671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:10.711321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec474315-933d-4d3f-9a59-275089ff428a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.720129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:10.761488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.762111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.762392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.762663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.764202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=f50b465c16524370bc5ba3350c015db1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:10.764202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.765181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.771531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 100/199] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:10 2022] GET /identity/v3/role_assignments?user.id=f50b465c16524370bc5ba3350c015db1&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:10.772223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:10.815198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 100/200] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:10.924473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025cf430-8f34-46e8-876e-54ed723e313b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:10.978083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:10.978728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:10.979710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:10.980169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:10.981339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:10.982792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:10.989625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 101/201] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:10 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:10.996900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:11.147903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:11.153414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147247e6-b818-4458-a4be-f5466c7fb0a1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:11.188765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:11.199675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:11.200336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:11.200615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:11.200888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:11.201634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=f50b465c16524370bc5ba3350c015db1) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:11.201940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:11.204000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:11.210457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 101/202] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:10 2022] GET /identity/v3/role_assignments?user.id=f50b465c16524370bc5ba3350c015db1&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=6cc679021d904431823a4fe019f8ddcb => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:11.283594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:11.378727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf03193-95ae-46dd-92ca-e91f9c95973e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:11.423625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:11.424310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:11.424598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:11.424880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:11.438306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:11.443791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:11.444705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:11.445516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:11.446125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 102/203] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:11.453232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:11.576374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8555-ee12-4b88-9899-b2a577bb7960 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:11.612414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:11.613086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:11.613364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:11.613689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:11.614462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:11.614789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:11.616276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:11.626943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 102/204] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:11.632564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:11.738544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:11.746843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc21024-d084-4c05-a636-97635ef95c61 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:11.799969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:11.800712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:11.800998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:11.801274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] PATH_INFO: `/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:11.802458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] RBAC: Authorizing `identity:get_user(user_id=8b4ec7f1a1a44310b06f2f2f2f1c43b3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:11.803957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:11.805581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 103/205] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:11 2022] GET /identity/v3/users/8b4ec7f1a1a44310b06f2f2f2f1c43b3 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:11.812559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:11.855288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:11.941109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75a698-5f74-41f0-8152-a7bb34c7264f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:11.978595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:11.979895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:11.980172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:11.980439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:12.055932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:12.057963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:12.086611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:12.171098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 103/206] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:12.172530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:12.279504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b3215-bfd1-4b29-ac51-3c1421bab33c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:12.315300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:12.315915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:12.316198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:12.316563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:12.317699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:12.319144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2bd8-f5b7-4e72-8ed5-0a64ea094c6d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:12.320809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 104/207] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:12 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:12.327545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:12.431566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63b9bf-2ab1-4f04-8309-6171e8d1ef2b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:12.460217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:12.473925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:12.474612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:12.474895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:12.475169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:12.475955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, scope.project.id=f93427a005164aa5b7b1532ba195f5b1, user.id=8b4ec7f1a1a44310b06f2f2f2f1c43b3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:12.476262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:12.477779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea25b60-1d95-4397-afbb-3b37eff7938c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:12.484649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 104/208] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:12 2022] GET /identity/v3/role_assignments?user.id=8b4ec7f1a1a44310b06f2f2f2f1c43b3&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:12.961740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8677-0076-45a7-affd-e8cd52be7a99 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:12.962126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8677-0076-45a7-affd-e8cd52be7a99 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:12.962410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c8677-0076-45a7-affd-e8cd52be7a99 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:12.964555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 105/209] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:12.970130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699231c9-fe26-4c55-9fed-fa456e13209b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:12.970416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699231c9-fe26-4c55-9fed-fa456e13209b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:12.970691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699231c9-fe26-4c55-9fed-fa456e13209b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:12.990357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-699231c9-fe26-4c55-9fed-fa456e13209b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:12.991569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-699231c9-fe26-4c55-9fed-fa456e13209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:13.067666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 105/210] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:13.158728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407088-9cbf-4fe1-9ef0-7a0a67bc8097 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.159463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407088-9cbf-4fe1-9ef0-7a0a67bc8097 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.160027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08407088-9cbf-4fe1-9ef0-7a0a67bc8097 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.161627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 106/211] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:13.168429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.169026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.169504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.193595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:13.195319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:13.215898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc8f4-89ad-4ce2-9e38-abb03a323b59 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.216179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc8f4-89ad-4ce2-9e38-abb03a323b59 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.216386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fc8f4-89ad-4ce2-9e38-abb03a323b59 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.217989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 107/212] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:13.223420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.223705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.224029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.244445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:13.246223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:13.296064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 106/213] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:13.303552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:13.356888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:13.378511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 108/214] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:13.421255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:13.470481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9c7d8e-2f46-4b2c-ae32-6dfe675eaa0a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:13.506897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:13.507553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.507860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.508136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.509258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:13.511318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:13.513283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 107/215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:13.519224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:13.666492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:13.689212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60847-2499-4c9a-9c9c-fbc733cc3dd8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:13.727824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:13.728386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.728670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.729002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.729860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:13.731451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:13.759264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 109/216] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:13 2022] POST /identity/v3/users => generated 297 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:13.836447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:13.862298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f30e11-fe3d-4b21-a848-29d19ac77038 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:13.863256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:13.898842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:13.929204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:13.929861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:13.930240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:13.930534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:13.945987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:13.951636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:13.952600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:13.953409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 108/217] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:13.958674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:13.984010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10326ea1-def1-4647-aa01-b6a56f4572bd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.047817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.048499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.048880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.049195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.066971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f059bfe0-a57b-480c-9a8c-53185446f3a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:14.073804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:14.074716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:14.075511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:14.077978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 110/218] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:14.079442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9895ac-4bf3-4a1c-8aaf-01cfd348143b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.080250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9895ac-4bf3-4a1c-8aaf-01cfd348143b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.080707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9895ac-4bf3-4a1c-8aaf-01cfd348143b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.082588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 111/219] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:14.086386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9895ac-4bf3-4a1c-8aaf-01cfd348143b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.120309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f12bd2-c1e3-4b35-98da-3491a10b219d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.156331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.156954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.157269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.157640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.158318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:14.158624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.160045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56044d9-b745-492d-8e4f-8a34b6ba7a84 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.170799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 109/220] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:14.171912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.172190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.172466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.195963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:14.197268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:14.221388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.243838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9895ac-4bf3-4a1c-8aaf-01cfd348143b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.248166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.288503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.289288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.289575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.289853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.290925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:14.291268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.294193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.297915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 110/221] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:14.299534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.308582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 112/222] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:14.316801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.438425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9196165-a259-4ddf-855e-850745f20657 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.493770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.496452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.496879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.499015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.500411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.502306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.505454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 113/223] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:14.513066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.537154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9db9ab-5044-4702-8138-d5014be67547 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.539468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.607495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.608469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.609331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.609876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] PATH_INFO: `/v3/users/293019920d4645c399bfb47d48df4013` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.629021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] RBAC: Authorizing `identity:get_user(user_id=293019920d4645c399bfb47d48df4013)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.630799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.633456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 111/224] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/users/293019920d4645c399bfb47d48df4013 => generated 297 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:14.639375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.684168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.692864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7d41d-38e9-4039-a123-7434865f3c85 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.734620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.735397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.735776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.736133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.738482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.740047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.741799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 114/225] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:14.743799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:14.777737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83768eff-3256-4d15-9bad-6b7e8192faa8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.817723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.818562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.818934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.819303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.851615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.884055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98388a3-65b6-4352-b0bb-4a7185e2599d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:14.899231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:14.901935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:14.927943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:14.929229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:14.930181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:14.930670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:14.935542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:14.947949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:14.955303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:14.956283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:14.957087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:14.959310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 115/226] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:14.965529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.034276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 112/227] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:15.035395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.092547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521c36f-f7d0-45eb-b050-bcaf42281de5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.132032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.133139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.133639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.134120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/f50b465c16524370bc5ba3350c015db1/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.136632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, user_id=f50b465c16524370bc5ba3350c015db1, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.139339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.151188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:15.163230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb55ae5-7902-459e-ac64-bd82c09a6a0d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.168684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 116/228] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:14 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/f50b465c16524370bc5ba3350c015db1/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:15.169927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.241819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:15.259675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.261215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.262089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.263067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.264517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:15.265363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.269586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.289256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 113/229] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:15.299263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.361667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d4cc0-aebd-44d6-b9c2-f6907f07a7a0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.409365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.409741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.409975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.410250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.411375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.412864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.414790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 117/230] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:15 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:15.421673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.441457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724307fa-e7d8-4d7c-b1c2-743ae43c624d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.481891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.482931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.483532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.484079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.485595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.487271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.489185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 114/231] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:15 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:15.495149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.541397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:15.583390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:15.630009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc42cad-0993-4284-ae00-882455840461 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.634052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bd61c-5189-4169-93e2-f384274f5851 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.672399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.673521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.674007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.674534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.676079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.679420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.681947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 115/232] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:15 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:15.690233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:15.701194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.701826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.702109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.702383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.703124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=293019920d4645c399bfb47d48df4013) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:15.703429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.705565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841e60-81cf-4940-8b64-3582df291696 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.721803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 118/233] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:15 2022] GET /identity/v3/role_assignments?user.id=293019920d4645c399bfb47d48df4013&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:15.840991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6157d-f1b3-4438-a41d-9f5f8e8e2ef9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:15.881544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:15.893350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:15.894434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:15.894938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:15.895445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/f50b465c16524370bc5ba3350c015db1/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:15.898210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, user_id=f50b465c16524370bc5ba3350c015db1, role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:15.900109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88081617-d044-4a17-8345-8dfdb5f76ad6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:15.921848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 116/234] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:15 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/f50b465c16524370bc5ba3350c015db1/roles/6cc679021d904431823a4fe019f8ddcb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:16.249850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf80cb-0be5-4e39-a843-0a298413aefa None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:16.250036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf80cb-0be5-4e39-a843-0a298413aefa None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:16.250316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf80cb-0be5-4e39-a843-0a298413aefa None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:16.252101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 119/235] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:16.259044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f70c-3ff9-46fe-8eb0-37590156a122 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:16.259511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f70c-3ff9-46fe-8eb0-37590156a122 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:16.260008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0f70c-3ff9-46fe-8eb0-37590156a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:16.284619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-47e0f70c-3ff9-46fe-8eb0-37590156a122 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:16.285819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-47e0f70c-3ff9-46fe-8eb0-37590156a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:16.396268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 117/236] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:16.514794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135732-5baa-4a4c-86f1-e8158ceb550b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:16.515287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135732-5baa-4a4c-86f1-e8158ceb550b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:16.515287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14135732-5baa-4a4c-86f1-e8158ceb550b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:16.516770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 120/237] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:16.523235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:16.523518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:16.523825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:16.564872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:16.566170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:16.665682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 118/238] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:16.833910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135732-5baa-4a4c-86f1-e8158ceb550b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:16.995827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14135732-5baa-4a4c-86f1-e8158ceb550b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:17.023595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:17.064751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:17.083667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:17.084797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.085209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.085709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.087917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:17.091233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:17.093224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 121/239] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:17.100660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:17.137660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:17.233300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3fa2e-337b-452b-824d-efe50d0e74a7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:17.293219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982ddab-2fa3-44e5-9c8f-000096ef4c4e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:17.299605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:17.301947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.302456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.302956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.323449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:17.336830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:17.337792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:17.339181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:17.348821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 119/240] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:17.352608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:17.371639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:17.372658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.373186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.373720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.374601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:17.376552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:17.424405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 122/241] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:17 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:17.516132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b172e-bc13-46af-915b-8f9938ae6ef7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:17.536356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:17.587048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:17.587601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.587910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.588297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.588991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:17.589407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:17.590819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f31bab-68e6-4c2f-8f28-13a4203cd2f3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:17.604853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 120/242] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:17.610363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:17.704108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:17.763609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e04660a-9397-4044-9633-204d5468fa1f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:17.801870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:17.802562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.802854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.803123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] PATH_INFO: `/v3/users/86c59e27b3ed4641bdda11ded779c706` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.819194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=86c59e27b3ed4641bdda11ded779c706)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:17.820734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd77846f-711a-4282-9f2a-2754b4185dc5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:17.821012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ea1a-23d2-4b82-aa56-96ce2530b016 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.821696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ea1a-23d2-4b82-aa56-96ce2530b016 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.821696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600ea1a-23d2-4b82-aa56-96ce2530b016 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.822778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 123/243] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:17 2022] GET /identity/v3/users/86c59e27b3ed4641bdda11ded779c706 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:17.822932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 121/244] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:17.828455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:17.828809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:17.829146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:17.832983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ea1a-23d2-4b82-aa56-96ce2530b016 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:17.849610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:17.850731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:17.948952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 124/245] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:17.987021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600ea1a-23d2-4b82-aa56-96ce2530b016 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:18.031518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:18.032196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.032480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.032759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.075204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:18.117074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:18.118487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:18.230950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 122/246] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:18.236612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:18.261206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:18.296450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:18.372431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075edf9f-b7c2-43c2-b9c3-1982aaf04c8c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:18.384822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:18.445210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:18.445888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.446176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.446452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.449603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:18.454706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3814bc23-0879-4337-be49-46e6a8409f94 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:18.457363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:18.459157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 125/247] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:18 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:18.465231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:18.525194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:18.525939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.526426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.526709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.546452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f6f4ab97-ef95-4680-93ce-886fe61c68b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:18.560134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:18.561083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:18.562313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 123/248] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:18.563056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000e09-9430-4066-8e66-42a6aac82f85 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.563056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000e09-9430-4066-8e66-42a6aac82f85 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.563176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000e09-9430-4066-8e66-42a6aac82f85 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.567069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 124/249] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:18.568680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000e09-9430-4066-8e66-42a6aac82f85 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:18.721379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052bf68-dc14-4817-9f7e-bf4e078043cc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:18.740446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:18.778253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:18.779155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.779442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.779720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.780524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=86c59e27b3ed4641bdda11ded779c706) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:18.781100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:18.783367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d114d-7ebc-4abb-871a-2186c3f270aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:18.786510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000e09-9430-4066-8e66-42a6aac82f85 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:18.792329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 126/250] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:18 2022] GET /identity/v3/role_assignments?user.id=86c59e27b3ed4641bdda11ded779c706&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:18.793778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7d5f-ce98-4af1-9109-026b88ebf9dd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.794070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7d5f-ce98-4af1-9109-026b88ebf9dd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.794348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c7d5f-ce98-4af1-9109-026b88ebf9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.831794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd3c7d5f-ce98-4af1-9109-026b88ebf9dd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:18.834902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd3c7d5f-ce98-4af1-9109-026b88ebf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:18.861194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:18.868900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:18.870221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.871002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.871002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.871611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:18.871956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:18.874184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96378a-2630-4c51-afe4-a62e7e610f3e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:18.902089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 125/251] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:18.904891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca592c9-2f0c-4e30-93c0-6e6cc39cce39 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.905181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca592c9-2f0c-4e30-93c0-6e6cc39cce39 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.905464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca592c9-2f0c-4e30-93c0-6e6cc39cce39 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:18.908295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 126/252] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:18.911563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca592c9-2f0c-4e30-93c0-6e6cc39cce39 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:18.989153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 127/253] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:18.993123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:18.993622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:18.994091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:19.034486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:19.036247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:19.139419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca592c9-2f0c-4e30-93c0-6e6cc39cce39 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:19.184885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 128/254] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:19.197372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:19.199713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:19.200228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:19.200716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:19.202078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:19.203725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:19.205546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 127/255] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:18 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:19.212905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:19.260741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:19.347619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f34209-5324-4d7a-8bb3-4387215c5938 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:19.375821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:19.390764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:19.391391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:19.391668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:19.391973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:19.508129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:19.534166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:19.535548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:19.593876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c8561-65d4-4ee0-b2cc-1010776fe935 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:19.599314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:19.664214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:19.665339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:19.665916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:19.667243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:19.683783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 129/256] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:19.688503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:19.693007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:19.703801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:19.705356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:19.706774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:19.709857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 128/257] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:19.717978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:19.833823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc4d5b9-02cd-4279-a02d-f44fde2ab524 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:19.887393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:19.888090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:19.888381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:19.888662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:19.889905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:19.891475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:19.898132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 130/258] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:19 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:19.898989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:19.904055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:19.950283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d91ca-2d7a-4921-8341-f491b4188172 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:19.984158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.022254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c65fe6-7bdf-42bc-a1aa-5b2caa1fa6b6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.034499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.035137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.035425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.035700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.036414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:20.036721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.038122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.054807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 129/259] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:20.055690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.061998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.062722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.063009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.063282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.076053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:20.081288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:20.082216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:20.083046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 131/260] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:20.088814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.157877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.204042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610c7eb0-81a8-405c-b61b-56300a625f4f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.246361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.247115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.247403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.247686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] PATH_INFO: `/v3/users/f50b465c16524370bc5ba3350c015db1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.249505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] RBAC: Authorizing `identity:get_user(user_id=f50b465c16524370bc5ba3350c015db1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.251494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.253451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 132/261] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/users/f50b465c16524370bc5ba3350c015db1 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:20.254135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.320506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600f0b-daa7-4143-8014-310e8992edc9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.395972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.396549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.396842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.397119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.397870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=f50b465c16524370bc5ba3350c015db1) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:20.398178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.399647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.421931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 130/262] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/role_assignments?user.id=f50b465c16524370bc5ba3350c015db1&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:20.422627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.460605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551c19b-8005-4751-ae78-b37e2db478c6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.553165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.560798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.563127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.563127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.563127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.563127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:20.563127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.564592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.566466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.585315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 133/263] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:20.593860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.695793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5abe9-b2e9-4efc-a1cb-fac931d2d897 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.742869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.743812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.744178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.744595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.763570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cb3f6-d8e9-432b-a960-6377d47eca03 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.819484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:20.820165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.820441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.820737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] PATH_INFO: `/v3/users/293019920d4645c399bfb47d48df4013` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.821883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] RBAC: Authorizing `identity:get_user(user_id=293019920d4645c399bfb47d48df4013)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.824195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd0bbf-f3d1-44c5-8d67-4762cbe9940d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.826527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 134/264] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/users/293019920d4645c399bfb47d48df4013 => generated 297 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:20.827059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76795-e54d-4ee7-a9f9-785daee7a728 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.827343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76795-e54d-4ee7-a9f9-785daee7a728 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.827619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce76795-e54d-4ee7-a9f9-785daee7a728 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.830454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 135/265] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:20.830797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5556-7e2e-40fb-a817-5db2f5eb60e8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.831085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5556-7e2e-40fb-a817-5db2f5eb60e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.831358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5556-7e2e-40fb-a817-5db2f5eb60e8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:20.835789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 136/266] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:20.835789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5556-7e2e-40fb-a817-5db2f5eb60e8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:20.848953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:20.850740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd8d22-54a7-459c-8e42-03a3b2e51ffa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:20.908521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.913599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:20.956519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5556-7e2e-40fb-a817-5db2f5eb60e8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:20.995626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 131/267] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:20.995626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:20.995626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:20.995626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.011375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.012084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.012311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.012584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.013710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.013898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:21.015109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:21.015242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057e092b-d554-41d2-a5cd-5f0a1379c9e9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:21.017050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 137/268] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:20 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:21.024630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.024915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.025184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.046732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:21.047988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:21.111806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 132/269] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:21.112608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.145803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 138/270] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:21.147000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.220456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.269159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.275352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef91768-b8fd-4ecc-b24c-17142c294556 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.318405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.319449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.319990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.320474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/293019920d4645c399bfb47d48df4013/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.323475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, user_id=293019920d4645c399bfb47d48df4013, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.325420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1b1eb-fdc7-4c24-9db3-c45fed2b3a2d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:21.335878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06969cd-578f-4d3c-8e8a-6688bb802248 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.351523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 139/271] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:21 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/293019920d4645c399bfb47d48df4013/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:21.353649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79145-8f2d-4ef3-bc68-46f550510cdf None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.354836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79145-8f2d-4ef3-bc68-46f550510cdf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.356061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed79145-8f2d-4ef3-bc68-46f550510cdf None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.357882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 140/272] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:21.366417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.366731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.367023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.391196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.392053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.392338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.392627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.393865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.396292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:21.403797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 133/273] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:21 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:21.405146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:21.406601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:21.409190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.513227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 141/274] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:21.520091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.556208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5796e0d-09be-4b8a-9981-fd5f138c8b8d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.587782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.607345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.608368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.608932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.609211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.609973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=f50b465c16524370bc5ba3350c015db1) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:21.610290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.611825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:21.618500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 134/275] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:21 2022] GET /identity/v3/role_assignments?user.id=f50b465c16524370bc5ba3350c015db1&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=6cc679021d904431823a4fe019f8ddcb => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:21.620176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.635613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.658686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f51d2-677e-4496-a6a1-39cc0e5d7e8e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.703535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.704495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.704785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.705543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.706959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.708620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:21.710375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 142/276] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:21.716992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.756982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f7445-e852-42db-baf1-abebf4896e4e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.805849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.806655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.807050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.807365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.832213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:21.837966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:21.839980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 135/277] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:21.840802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:21.909345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9a014-2e5c-4379-8bff-56ca27e6a39c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:21.935467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.966291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:21.975034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:21.975653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:21.975986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:21.976255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:21.976941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:21.978512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.012479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 143/278] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:21 2022] POST /identity/v3/users => generated 293 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:07:22.014900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf75bafc-0f3e-4eca-a0bc-ecc07a819db0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.024767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.065112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.065795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.066152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.066942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.084493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:22.092082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:22.093077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:22.093880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 136/279] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:22.099261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.179249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f70e45-a9f7-4e99-9f07-9f23f60c7d18 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.231348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bcc1d-ff2b-4a6b-9d58-9bf0c20dbe10 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.233903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.233903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.233903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.233903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.234282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:22.234282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.235595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.248818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 144/280] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:22.254237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.262987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:22.273154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.273777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.274056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.274329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.275040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:22.275342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.277247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.286896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 137/281] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:22.293498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.300526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:22.406098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac8c83-37bd-4a45-b7ff-b4691492514d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.438623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7953c-1a4b-4a84-b0a5-20236d68c59b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.444967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.445664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.445946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.446218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] PATH_INFO: `/v3/users/71249de82da44539b0abbffb410ac22f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.473143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] RBAC: Authorizing `identity:get_user(user_id=71249de82da44539b0abbffb410ac22f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.475337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.478118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 145/282] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/users/71249de82da44539b0abbffb410ac22f => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:22.482683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.483340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.483619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.483946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] PATH_INFO: `/v3/users/86c59e27b3ed4641bdda11ded779c706` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.485514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] RBAC: Authorizing `identity:get_user(user_id=86c59e27b3ed4641bdda11ded779c706)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.486160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.486977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.488931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 138/283] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/users/86c59e27b3ed4641bdda11ded779c706 => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:22.496858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.600662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:22.627940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:22.640978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafddbde-983d-4b48-afaf-5ef9520cad33 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.685788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.686763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.686872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948f66e-f87c-4df3-b285-84b2e5263832 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.687362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.687888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.688925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, user.id=71249de82da44539b0abbffb410ac22f, scope.system=all) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:22.689467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.692578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.698991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 146/284] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/role_assignments?user.id=71249de82da44539b0abbffb410ac22f&scope.system=all&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:22.767903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.768591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.768941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.769218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.772800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.774456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc834b-90a4-42ae-ac6a-0443a9f6665a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:22.784681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 139/285] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:22 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:22.790598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:22.942949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82ddb2-5ae3-4cc5-8eab-0ebd0f03bc61 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:22.985357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:22.986031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:22.986311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:22.986580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/86c59e27b3ed4641bdda11ded779c706/roles/911df5e7fdbe47aeaaab529626805d92` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:22.988555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, user_id=86c59e27b3ed4641bdda11ded779c706, role_id=911df5e7fdbe47aeaaab529626805d92)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:22.990010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168a847-1831-4c7c-81b0-67cbbe48a0c2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:23.009894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 147/286] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:07:22 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/users/86c59e27b3ed4641bdda11ded779c706/roles/911df5e7fdbe47aeaaab529626805d92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:24.036898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9d95-b7ea-47d0-aed8-1f4f5156f54b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.037430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9d95-b7ea-47d0-aed8-1f4f5156f54b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.037430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f9d95-b7ea-47d0-aed8-1f4f5156f54b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.039044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 140/287] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:24.045480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.045947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.046241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.082402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:24.083625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:24.099591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:24.185401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 148/288] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:24.593419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9d95-b7ea-47d0-aed8-1f4f5156f54b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:24.735834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f9d95-b7ea-47d0-aed8-1f4f5156f54b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:24.773310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:24.786077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:24.786722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.787067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.787348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.798879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7a8c0a69-7b0f-40c6-b97b-85354c3c85c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:24.804571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:24.805470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:24.806268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 141/289] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:24.812828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:24.828720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd985-704a-45f4-8678-56cc3ddea517 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.828977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd985-704a-45f4-8678-56cc3ddea517 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.829199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fd985-704a-45f4-8678-56cc3ddea517 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.830793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 142/290] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:24.837245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465c0b-c44a-4563-9fa7-ee299866fe54 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.837526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465c0b-c44a-4563-9fa7-ee299866fe54 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.837799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3465c0b-c44a-4563-9fa7-ee299866fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.869225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d3465c0b-c44a-4563-9fa7-ee299866fe54 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:24.871413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d3465c0b-c44a-4563-9fa7-ee299866fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:24.952490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1635600-186d-4690-be01-1a8b59bbaaba None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:24.963776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 143/291] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:24.965640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a773-9529-4618-ae6d-58d24560a588 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.966136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a773-9529-4618-ae6d-58d24560a588 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.966623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38a773-9529-4618-ae6d-58d24560a588 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.972256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 144/292] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:24.985709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991f84-8957-4418-8581-3e3a2139f4d0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.986448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991f84-8957-4418-8581-3e3a2139f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.987004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91991f84-8957-4418-8581-3e3a2139f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.989694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:24.990306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:24.990590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:24.990883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:24.991562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:24.991878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:24.993244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.003446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 149/293] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:25.008745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.020399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.023027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-91991f84-8957-4418-8581-3e3a2139f4d0 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:25.024607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-91991f84-8957-4418-8581-3e3a2139f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:25.115427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8251e8c-a898-4fa3-83aa-c48af2b57571 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.150423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.151803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.152186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.152452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] PATH_INFO: `/v3/users/293019920d4645c399bfb47d48df4013` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.153615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] RBAC: Authorizing `identity:get_user(user_id=293019920d4645c399bfb47d48df4013)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:25.155063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.156971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 150/294] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/users/293019920d4645c399bfb47d48df4013 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:25.162476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.169142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 145/295] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:25.248183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.272447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c131beb-8e55-43c1-b143-0e83a7154707 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.309321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.309939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.310223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.310505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.342129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082e5-09e5-44a2-81e2-8fff5ac15aab None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.342389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082e5-09e5-44a2-81e2-8fff5ac15aab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.342675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08082e5-09e5-44a2-81e2-8fff5ac15aab None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.348486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 146/296] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:25.355406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.355709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.356012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.383508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:25.384817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:25.417409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:25.420158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.488158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.512610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 147/297] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:25.516754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.547193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.579318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 151/298] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:25.580235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.678597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308fc448-3e46-4323-af86-a601a4d49743 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.703007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4a3c9-d7ff-40f6-ae53-c60ebb66bbad None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.723815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.724331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.724686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.725033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.737226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:25.740992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.741646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.741928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:25.742026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:25.742904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:25.743813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:25.744989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.745068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 148/299] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:25.745068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.748607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:25.750574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135b24f-39c2-489f-8a1e-b4fc1cec184d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 152/300] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e413b2-0630-45ab-8340-17e0f1007a3f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e413b2-0630-45ab-8340-17e0f1007a3f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e413b2-0630-45ab-8340-17e0f1007a3f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 153/301] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:25.758420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e413b2-0630-45ab-8340-17e0f1007a3f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.793573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.808666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:25.865481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e413b2-0630-45ab-8340-17e0f1007a3f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.865867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c65cb8-92fe-4080-ac3d-15bf3168e486 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:25.902459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.902683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:25.903077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.903183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.903363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.903505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.903642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.903741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.904355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:25.904663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:25.904882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:25.906059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d0d2e-5c2b-4e28-b0dc-6526b2c516cf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.906323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:25.908016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 149/302] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:25.908777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:25.915112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 154/303] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:25.916537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:25.916828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:25.917121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:25.935499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:25.936688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:26.005875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 155/304] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:26.007105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.013965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac340f4-5e3a-4084-a8ef-9f093d9e2397 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.015955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.045939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.053708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.054331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.054620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.054903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] PATH_INFO: `/v3/groups` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.055537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.057969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.078822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 150/305] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Aug 23 23:07:25 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:26.080050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.155745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef21b5ee-9e8c-4899-9586-a1abccdcab70 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.197726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.198831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.199323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.199857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.212588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:26.218310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:26.219337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:26.220187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:26.222719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 156/306] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:26.227533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562210d6-9a97-4b83-9776-ad95595e0f80 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.229820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.266350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.266968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.267246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.267519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.268466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=293019920d4645c399bfb47d48df4013) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:26.268779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.271690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.279295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 151/307] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/role_assignments?user.id=293019920d4645c399bfb47d48df4013&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.280632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.360220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.361570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.379280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9eff04d-4f3e-453a-99fa-60604f94df27 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.434273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.435491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.437046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.437868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] PATH_INFO: `/v3/users/1da07a1b30f04ea3a76ad62403ebce43` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.464180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] RBAC: Authorizing `identity:get_user(user_id=1da07a1b30f04ea3a76ad62403ebce43)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.465833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.467576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 157/308] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/users/1da07a1b30f04ea3a76ad62403ebce43 => generated 293 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.472714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.508689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8508d0d-788f-46c0-8dde-f7c56a2e31b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.571310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.571508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.572133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.572312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.575034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:26.575034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.575034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.583994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 152/309] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.584842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.616016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8360d4a-f526-46af-b31f-ce2110feed15 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.654327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.655094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.655453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.655733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.667780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:26.672687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:26.673603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:26.674443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:26.678566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 158/310] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:26.679439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.688351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.697266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:26.703422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81103843-e0be-46c1-97d1-92af97582630 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.741296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.741832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.742115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.742392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.743133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, user.id=1da07a1b30f04ea3a76ad62403ebce43, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:26.743447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.745602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.755794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 153/311] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/role_assignments?user.id=1da07a1b30f04ea3a76ad62403ebce43&scope.system=all&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.755794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.825032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac5d87-a4a4-43ed-b299-ba55ac2bc7eb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.868496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cda6e-8dc0-44b5-80f0-ab4042d77634 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:26.882430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.883089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.883373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.883651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] PATH_INFO: `/v3/users/71249de82da44539b0abbffb410ac22f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.886301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] RBAC: Authorizing `identity:get_user(user_id=71249de82da44539b0abbffb410ac22f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.887856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.889601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 159/312] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/users/71249de82da44539b0abbffb410ac22f => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.896536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.918132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:26.919263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:26.919700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:26.920162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:26.921009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] RBAC: Adding query filter params (name=reader) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:26.921469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:26.923138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:26.935526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 154/313] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:26.941631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:26.965223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:27.021640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:27.048746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f51cfa0-b110-41a7-a4b1-1bad18c270a7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:27.076509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a8216-7065-4e7b-ab2d-06a59a1c69cf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:27.096189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:27.096863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:27.097147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:27.097424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] PATH_INFO: `/v3/system/users/71249de82da44539b0abbffb410ac22f/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:27.099579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=71249de82da44539b0abbffb410ac22f, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:27.102701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:27.120199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 160/314] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Aug 23 23:07:26 2022] PUT /identity/v3/system/users/71249de82da44539b0abbffb410ac22f/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:07:27.127200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:27.127957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:27.128238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:27.128631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] PATH_INFO: `/v3/users/86c59e27b3ed4641bdda11ded779c706` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:27.129971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] RBAC: Authorizing `identity:get_user(user_id=86c59e27b3ed4641bdda11ded779c706)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:27.131788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:27.134487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 155/315] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:26 2022] GET /identity/v3/users/86c59e27b3ed4641bdda11ded779c706 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:27.140674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:27.275694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426bb6c8-199a-4791-8609-706d0c2335cb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:27.317608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:27.318235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:27.318520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:27.318794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:27.337756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:27.403989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:27.405518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:27.516751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 161/316] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:27.522307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:27.619194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:27.640776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dcc7b-d06a-4449-bf95-094b22ad3a78 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:27.680985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:27.682074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:27.682594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:27.683111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:27.684575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:27.686284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a304a090-54bb-4102-98c8-0efad2d96450 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:27.688548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 156/317] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:27 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:27.699786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:27.747467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:27.813256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c22e-5f32-4555-87e9-d5bafeec5809 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:27.851892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:27.852507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:27.852792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:27.853069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:27.853842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81, user.id=86c59e27b3ed4641bdda11ded779c706) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:27.854152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:27.855604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eda5dd3-0844-4d5d-b1bd-90cde2f0454d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:27.862239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 162/318] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:27 2022] GET /identity/v3/role_assignments?user.id=86c59e27b3ed4641bdda11ded779c706&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:28.194310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d9e4-cd6a-403a-be64-e1a252e20c5c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.194545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d9e4-cd6a-403a-be64-e1a252e20c5c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.194973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d9e4-cd6a-403a-be64-e1a252e20c5c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.196503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 157/319] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:28.202183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.202478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.202760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.221914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:28.223126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:28.295855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 163/320] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:28.565226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d9e4-cd6a-403a-be64-e1a252e20c5c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:28.705503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d9e4-cd6a-403a-be64-e1a252e20c5c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:28.758385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:28.759428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.759994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.760457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.763558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:28.765820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1a63d-ce51-40ea-a5af-3b2757af850c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:28.767703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 158/321] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:28.774383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:28.794056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3fcd-2368-467d-b6fd-bf2746a2de81 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.794736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3fcd-2368-467d-b6fd-bf2746a2de81 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.795016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba3fcd-2368-467d-b6fd-bf2746a2de81 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.796419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 159/322] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:28.802298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.802590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.802872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.821389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:28.822546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:28.833310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:28.841153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:28.900357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a8fe0-4a88-47a7-bc78-3153a516cd6e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:28.908855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 160/323] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:28.943477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:28.944139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:28.944418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:28.944693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] PATH_INFO: `/v3/groups` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:28.945377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:28.946826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfebbb1-14dd-4799-a0f3-f7c275eb15cb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:28.971782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 164/324] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Aug 23 23:07:28 2022] POST /identity/v3/groups => generated 226 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:07:29.179239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.181227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31bc03-6d03-4aa2-bb4a-ed19147771bd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.181890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31bc03-6d03-4aa2-bb4a-ed19147771bd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.182207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31bc03-6d03-4aa2-bb4a-ed19147771bd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.184856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 165/325] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:29.190679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.190969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.191247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.211274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:29.212509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:29.299623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ead1a-a5ef-4282-a4cb-55d20d347f12 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:29.300751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 166/326] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:29.340875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:29.341530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.341854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.342135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.353792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:29.358917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:29.359896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:29.360698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 161/327] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:29.368329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.404589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:29.483559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a82145-38b2-40dd-b528-cce58bfa5451 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:29.521771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:29.522388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.522670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.522946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.523625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:29.523959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:29.525353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:29.534700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 167/328] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:29.541700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.556192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:29.588630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.665938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7069949-ed28-45c3-b4b3-284520fc1dc3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:29.708623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:29.718271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:29.718928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.719210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.719485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] PATH_INFO: `/v3/users/1da07a1b30f04ea3a76ad62403ebce43` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.720774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] RBAC: Authorizing `identity:get_user(user_id=1da07a1b30f04ea3a76ad62403ebce43)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:29.721247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7ea55-a52f-4f6c-9f2b-57fd7f46ab98 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:29.722257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:29.724091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 162/329] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:29 2022] GET /identity/v3/users/1da07a1b30f04ea3a76ad62403ebce43 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:29.731543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.781195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:29.782217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.782705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.783237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.800210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:29.808326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:29.809293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:29.810105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:29.813544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 168/330] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:29.819569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:29.835716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:29.867056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b747-3dfe-48ac-a9b0-99e2e3127321 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:29.914560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:29.915509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:29.915820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:29.916132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] PATH_INFO: `/v3/system/users/1da07a1b30f04ea3a76ad62403ebce43/roles/911df5e7fdbe47aeaaab529626805d92` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:29.919241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1da07a1b30f04ea3a76ad62403ebce43, role_id=911df5e7fdbe47aeaaab529626805d92)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:29.920706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:29.933825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 163/331] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Aug 23 23:07:29 2022] PUT /identity/v3/system/users/1da07a1b30f04ea3a76ad62403ebce43/roles/911df5e7fdbe47aeaaab529626805d92 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:07:29.968270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d532db-a2b4-4cba-bb85-76866a4591f3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:30.009368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:30.010766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:30.011304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:30.011740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:30.012528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:30.012887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:30.014383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:30.024903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 169/332] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:30.032013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:30.159431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6d7a0-23b1-48ff-8ab9-462cf68515e8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:30.200782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:30.201469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:30.201817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:30.202103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] PATH_INFO: `/v3/users/71249de82da44539b0abbffb410ac22f` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:30.203325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] RBAC: Authorizing `identity:get_user(user_id=71249de82da44539b0abbffb410ac22f)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:30.204826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02cc39c-1e87-4621-9a91-c66b07bcc37d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:30.206778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 164/333] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:30 2022] GET /identity/v3/users/71249de82da44539b0abbffb410ac22f => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:30.212529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:30.241850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:30.363642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2da8e-85b4-4abc-8ff2-8f134f0bc3ec None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:30.413561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:30.414510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:30.414974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:30.415426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:30.416788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] RBAC: Adding query filter params (role.id=68313c4b2f044fd184b6941eae76cd3a, user.id=71249de82da44539b0abbffb410ac22f, scope.system=all) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:30.417190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:30.418707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ab761-7e58-4508-b142-1c508a5a4695 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:30.436695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 170/334] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 23 23:07:30 2022] GET /identity/v3/role_assignments?user.id=71249de82da44539b0abbffb410ac22f&scope.system=all&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:31.613232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604a14-e735-4341-9e33-787df55849da None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:31.613745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604a14-e735-4341-9e33-787df55849da None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:31.613849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f604a14-e735-4341-9e33-787df55849da None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:31.615503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 165/335] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:31.623784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a49b4-9dba-4749-8e9f-ab820f014482 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:31.624294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a49b4-9dba-4749-8e9f-ab820f014482 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:31.624371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a49b4-9dba-4749-8e9f-ab820f014482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:31.644719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6d4a49b4-9dba-4749-8e9f-ab820f014482 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:31.645943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6d4a49b4-9dba-4749-8e9f-ab820f014482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:31.743843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 171/336] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:31.766898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f3f-1d1e-426c-a4b1-836a83eafb79 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:31.767227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f3f-1d1e-426c-a4b1-836a83eafb79 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:31.767467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc3f3f-1d1e-426c-a4b1-836a83eafb79 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:31.768859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 166/337] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:31.777257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:31.777539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:31.777824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:31.784527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:31.798447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:31.799670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:31.893784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 172/338] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:32.449710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3f3f-1d1e-426c-a4b1-836a83eafb79 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:32.461786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:32.585486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cc3f3f-1d1e-426c-a4b1-836a83eafb79 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:32.599016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:32.635082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:32.635799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:32.636097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:32.637078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:32.654261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8477bb9f-4ddd-4835-9a6d-181dc2deaabb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:32.659295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:32.660282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:32.661078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:32.663305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 167/339] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:32.667579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368d08-fd12-4ce5-b755-623477535f27 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:32.667951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368d08-fd12-4ce5-b755-623477535f27 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:32.668305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9368d08-fd12-4ce5-b755-623477535f27 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:32.669975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 168/340] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:32.670816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368d08-fd12-4ce5-b755-623477535f27 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:32.756032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a963d-afa2-4989-98fc-3eec621a02b5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:32.780155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:32.789176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:32.795612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:32.796422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:32.796664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:32.796986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:32.808765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3e63c5fe-55f9-46bc-ae7a-cd6bc1f6c3b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:32.813810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:32.814761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:32.815563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 173/341] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:32.816266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:32.816849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:32.816849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:32.839601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9368d08-fd12-4ce5-b755-623477535f27 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:32.843284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:32.844684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:32.897320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:32.898069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:32.898360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:32.898634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:32.899325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:32.899632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:32.902060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:32.911456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 169/342] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:32.916461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:32.920582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 174/343] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:32.921346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.118856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b018f7-1196-49b9-928e-e6cae9271961 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:33.129470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c5f15-6671-47d0-84b5-4246664981ec None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:33.162579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.179195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:33.180238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.180738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.181159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.182903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:33.183424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:33.184205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.186963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d4514-d2a9-4d13-a523-a28ef9ddf984 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:33.211522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 170/344] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:33.214069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289955f5-b9f8-41bf-91f6-61ba09f6a905 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.214641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289955f5-b9f8-41bf-91f6-61ba09f6a905 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.215146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289955f5-b9f8-41bf-91f6-61ba09f6a905 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.222232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 171/345] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:33.224427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:33.225063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.225347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.225937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.227266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289955f5-b9f8-41bf-91f6-61ba09f6a905 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.381643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:33.384415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f002b-c0c8-4756-84a7-1a5a7edb260d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:33.406928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289955f5-b9f8-41bf-91f6-61ba09f6a905 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:33.465332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:33.465957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.466236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.466571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.543211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 175/346] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 622 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:33.544665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.544957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.545127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.545264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.558752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:33.560582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:33.574825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:33.576054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:33.594372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.658179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 176/347] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:33.659498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.697528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 172/348] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:07:33.698707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.798954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d99a7ce-048b-4565-a3bb-4e6291e741bb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:33.823556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:33.837678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0faaa14-e9de-4fb3-9b06-3ef316f87646 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:33.843187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:33.844168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.844653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.845146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.862081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a2295d02-69a3-4c13-bdc5-e11c1cdfc5b3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:33.868486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:33.870248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 23 23:07:33.871490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:33.878044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:33.878401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 177/349] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:33.878608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.878897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.879170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.880522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:33.881473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a146-bcc8-40e2-aecf-07d5f35f4af8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:33.881994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:33.882422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a146-bcc8-40e2-aecf-07d5f35f4af8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:33.883098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09a146-bcc8-40e2-aecf-07d5f35f4af8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:33.883664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 173/350] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:33 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:33.885377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.887993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 178/351] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:33.889519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a146-bcc8-40e2-aecf-07d5f35f4af8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:33.913027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.018908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deba01e-b78f-4d1b-9202-48a327ef6875 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.032108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09a146-bcc8-40e2-aecf-07d5f35f4af8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.069995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.070754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.071132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.071407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.072849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.074231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.074845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f4115-824e-4e98-828d-2fc0182b9567 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.074951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.075200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.075484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.076254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:34.076499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.076938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 174/352] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:33 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.077894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.078107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.078392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.078710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.096192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 179/353] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.098048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.102907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:34.104850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:34.137248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.199117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.207167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 175/354] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:34.208044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.253592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa5316-0f83-4881-a05e-af6b55a55331 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.301892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.302546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.302832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.303112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.311868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.313290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.315152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 180/355] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.315804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.359080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b100d38f-dc3e-4195-83c0-a5e52964a5d3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.404461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.405114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.405401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.405681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.420739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:34.425704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:34.426602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:34.427559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 176/356] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:34.428265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.453521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.467428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04645-409d-4337-948d-aed9eee3746a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.507709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.508497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.509037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.509320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.513502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.515335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9efb0-2418-4b72-97f6-45d538a7355f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.517817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 181/357] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.518524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e7d2-1a4f-4423-bc6f-eb119081a206 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.518812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e7d2-1a4f-4423-bc6f-eb119081a206 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.519089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e7d2-1a4f-4423-bc6f-eb119081a206 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.520573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 182/358] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:34.523356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00e7d2-1a4f-4423-bc6f-eb119081a206 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.532804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.566783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc87b18-b163-46d3-a623-09898323bd29 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.612840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.613493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.613778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.614056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] PATH_INFO: `/v3/users/1da07a1b30f04ea3a76ad62403ebce43` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.615224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] RBAC: Authorizing `identity:get_user(user_id=1da07a1b30f04ea3a76ad62403ebce43)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.616849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.618498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 177/359] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/users/1da07a1b30f04ea3a76ad62403ebce43 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.619798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.661189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00e7d2-1a4f-4423-bc6f-eb119081a206 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.704539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.706061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.706061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.706243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.706862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=f93427a005164aa5b7b1532ba195f5b1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:34.707175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.708996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.717986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 183/360] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.720561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.746641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.766596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b548f-4775-45e4-ab69-aafb924bc3bd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.823051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.823955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.824171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.824556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.827170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:34.827170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:34.827433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:34.828190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fded507-134f-4f08-9043-ed9a16b0e41d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:34.842813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 178/361] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:34.845117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.845409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.845689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.867473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:34.868792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:34.872255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a650f93-1073-49d8-b0c7-80b5f16ec7fa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:34.915436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:34.916729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:34.917147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:34.917867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:34.935210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:34.941187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:34.942258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:34.943113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 184/362] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:34.944430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:34.953867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 179/363] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:34.954816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.040141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.062980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e3677-1074-44d7-9077-04e706a8d9ba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.063172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d896653-19af-4a3e-908f-1c2c5cc33004 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.096525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.101341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.101961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.102243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.102517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.103265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] RBAC: Adding query filter params (role.id=911df5e7fdbe47aeaaab529626805d92, user.id=1da07a1b30f04ea3a76ad62403ebce43, scope.system=all) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:35.103625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:35.104917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.105531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.105646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:35.105819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.106088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.106825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=f93427a005164aa5b7b1532ba195f5b1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:35.107256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:35.108925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:35.117204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 185/364] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=6cc679021d904431823a4fe019f8ddcb => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:35.119013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 180/365] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 23 23:07:34 2022] GET /identity/v3/role_assignments?user.id=1da07a1b30f04ea3a76ad62403ebce43&scope.system=all&role.id=911df5e7fdbe47aeaaab529626805d92 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:35.120232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.124217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.315410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8130-6c83-478b-bf79-54dc72050663 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.341497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae99ee-1030-44d3-8d8c-b7ad40b688c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.390784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.391418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.391699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.392816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.405558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.406313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.406605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.406884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.407597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:35.407970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:35.409389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:35.420151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.421774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 181/366] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:35.427060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.503628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.526943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:35.528893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:35.605553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f101f0-0c6b-4131-9a67-ea8c7df4a170 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.673853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.674864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.675354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.675857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.695439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 186/367] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:35.696937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.774533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.782862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:35.784799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:35.831186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:35.846529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcca9c-0cec-4e2a-b2ab-a573a8260dd9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:35.899542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:35.900531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:35.901188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:35.901696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:35.921394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:35.926222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:35.927147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:35.927993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 187/368] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:35.931546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:35.939677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 182/369] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:35.941298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.055473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f8fd9-8417-4702-9961-21da250fd91b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.076689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.084115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606b42a-2520-4bac-9a27-7447fcadf831 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.096038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.096964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.097242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.097515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.100977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.102734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.105983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 188/370] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.106790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.128415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.129034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.129320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.129597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.130388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:36.130721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.133343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.138030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.144418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 183/371] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.145669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.252138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba88cdf-493d-496d-bd38-3022c40006ea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.284991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e553b-7398-429b-811b-9c7fb28bcecc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.301503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.302147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.302429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.302734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.304874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.308295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.312158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 189/372] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.314000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.337324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.338551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.338892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.339210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.341969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.343882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.350595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 184/373] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.350595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.388599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.435568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.448335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea833be3-f0d2-45f1-bb50-9fd8e5a0cee0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.488024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e03cd-3059-49cd-b0cc-a5783cc3110c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.488707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.489656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.490193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.490727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.531890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.532858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.533145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.533691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.534981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.537042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.538826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 185/374] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.539605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.592219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.594124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.672204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.678900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeab994-4d7a-45b8-8c34-227029c25c75 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.712150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:36.722211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 190/375] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:36.723906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.724531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.724812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.725084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.725827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:36.726133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.727589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.727700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.734226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 186/376] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.735169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:36.867821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9987bad-a375-46d0-9e01-ef87cab38e9b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.902693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f6b794-b7ed-4058-957a-d78edee4cfd6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:36.912161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.912789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.913068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.913340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.914079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:36.914386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.917831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.924895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 191/377] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=6cc679021d904431823a4fe019f8ddcb => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:36.990772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:36.991453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:36.991737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:36.992103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] PATH_INFO: `/v3/projects/d2adca37f0d3413e86c54f533079bbbf` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:36.993752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] RBAC: Authorizing `identity:get_project(project_id=d2adca37f0d3413e86c54f533079bbbf)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:36.995341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca96051-0929-4d0f-8f01-f8f0e701c860 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:36.997418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 187/378] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:36 2022] GET /identity/v3/projects/d2adca37f0d3413e86c54f533079bbbf => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:37.003261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:37.063306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bbf1-dd9a-452f-b636-5f76b33e5de3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.063626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bbf1-dd9a-452f-b636-5f76b33e5de3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.063893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40bbf1-dd9a-452f-b636-5f76b33e5de3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.065264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 188/379] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:37.070921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.071213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.071496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.090415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:37.097068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:37.098330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:37.152542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:37.184982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e0b654-c0c3-4dd1-8df5-3438fd4e0c11 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:37.242856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 189/380] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:37.251600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:37.252275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.252564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.252848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] PATH_INFO: `/v3/groups/b86f644aaa214272a4452e01de6bdbe8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.258204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] RBAC: Authorizing `identity:get_group(group_id=b86f644aaa214272a4452e01de6bdbe8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:37.259671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:37.262023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 192/381] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:37 2022] GET /identity/v3/groups/b86f644aaa214272a4452e01de6bdbe8 => generated 229 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:37.268037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:37.391965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a6f7-bf25-4911-88a4-da470ef0bf09 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:37.428973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:37.429512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.429799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.430078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.430835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] RBAC: Adding query filter params (group.id=b86f644aaa214272a4452e01de6bdbe8, role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d2adca37f0d3413e86c54f533079bbbf) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:37.431151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:37.432987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3babfd-9a1d-4cd7-b67d-1aa15339f980 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:37.439552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 190/382] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:37 2022] GET /identity/v3/role_assignments?group.id=b86f644aaa214272a4452e01de6bdbe8&scope.project.id=d2adca37f0d3413e86c54f533079bbbf&role.id=fa42eaf240474f4086e94c0d56757850 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:37.713190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:37.877458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd4cb0-336a-43f2-8dbc-23c3966ed354 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:37.912489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda62be-27d9-475d-afb3-8b47c5ba4ceb None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.913271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda62be-27d9-475d-afb3-8b47c5ba4ceb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.913271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda62be-27d9-475d-afb3-8b47c5ba4ceb None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.915832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 191/383] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:37.916806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:37.923675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.923966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.927722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.950332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:37.951522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:37.962559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:37.967488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:37.968511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:37.969287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:37.970028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:37.995952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:38.008780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:38.011157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:38.012819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:38.014018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 193/384] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:38.024839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:38.053232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 192/385] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:38.211770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e8438-ef62-4e8a-9189-7732822ae404 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:38.255018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:38.255549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:38.255878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:38.256293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:38.256976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:38.257284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:38.258668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:38.272584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 194/386] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:38.278893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:38.485841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa5531-ac2c-487b-bbc2-28bf0d3242dd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:38.553993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:38.554575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:38.554862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:38.555138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:38.556308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:38.557849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:38.559457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 193/387] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:38 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:38.565810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:38.627315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:38.698299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24f7e7-40d7-468e-8fda-3075575cb840 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:38.711941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:38.742618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:38.743642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:38.744740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:38.745265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:38.746816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:38.748886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:38.751828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 195/388] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:38 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:38.759791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:38.769977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:38.861324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52acc2-8d8d-40ef-955b-cb462b5c9736 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:38.872115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:38.897910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:38.898669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:38.898852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:38.899127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/groups/70968c9c20b84b87a2612856d6b755ae/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:38.901684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, group_id=70968c9c20b84b87a2612856d6b755ae, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:38.903101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:38.924414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 196/389] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 23 23:07:38 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/groups/70968c9c20b84b87a2612856d6b755ae/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:38.984111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93762130-9505-48e5-ab3a-d5483fed7236 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:39.059858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:39.060969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.061461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.061934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.077994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:39.083936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:39.084910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:39.085722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:39.089273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 194/390] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:39.094743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:39.206608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f4515a-bca9-411c-8b27-789bceb6cdc8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:39.247182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:39.248226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.248714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.249191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.250128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:39.250666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:39.252534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39352cd-f8e3-42fc-b188-3a123d51734a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:39.262078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 197/391] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:39.268825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:39.344032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007e29-2358-40c0-9c65-611be6cbc48c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.344699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007e29-2358-40c0-9c65-611be6cbc48c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.345191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32007e29-2358-40c0-9c65-611be6cbc48c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.347264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 198/392] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:39.358639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.359345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.359863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.391043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:39.391264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:39.394947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:39.433230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c859931-faab-42f4-b9c2-9c495caf679d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:39.453439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:39.481724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:39.482798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.483286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.484364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.485799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:39.487500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:39.489730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 195/393] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:39 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:39.497770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:39.529728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 199/394] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:39.637667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5ffe34-50b6-4a9b-8762-1bb40a8cd7cb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:39.675344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:39.676351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.676826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.677304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.678642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:39.680352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849991b7-e8b3-4b76-8f15-25f80195c9bf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:39.683690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 196/395] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:39 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:39.692316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:39.806284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bacdd-fc3f-4d00-b0b9-fcb3943b6dcf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.807022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bacdd-fc3f-4d00-b0b9-fcb3943b6dcf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.807786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bacdd-fc3f-4d00-b0b9-fcb3943b6dcf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.809630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 197/396] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:39.814988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.815595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.816099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.836083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:39.837619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:39.850678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:39.869107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51094373-5b0b-4331-af46-5e8e643cffb9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:39.913848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:39.915419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:39.916618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:39.917434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1/groups/70968c9c20b84b87a2612856d6b755ae/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:39.920880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] RBAC: Authorizing `identity:create_grant(project_id=f93427a005164aa5b7b1532ba195f5b1, group_id=70968c9c20b84b87a2612856d6b755ae, role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:39.922568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:39.924271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 198/397] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:39.930006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:39.955175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 200/398] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 23 23:07:39 2022] PUT /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1/groups/70968c9c20b84b87a2612856d6b755ae/roles/6cc679021d904431823a4fe019f8ddcb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:40.101924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c7f4c-0680-49c6-845b-a704c97b7278 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.143332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.144376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.144888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.145382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.157320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:40.162357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:40.163224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:40.164056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:40.167537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 199/399] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:40.172927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.211352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:40.237322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.257307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:40.306815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b29b16-908d-4ba0-adcf-2f7d020de1fb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.358593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.359497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.359926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.360308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.361123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:40.361532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:40.363050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17404cf5-59af-49d2-b070-b88f0fd73ef2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:40.378357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 201/400] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:40.379814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66734-a6c1-4341-841f-7a11cb5933ce None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.380212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66734-a6c1-4341-841f-7a11cb5933ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.380593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde66734-a6c1-4341-841f-7a11cb5933ce None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.382307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 202/401] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:40.383033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde66734-a6c1-4341-841f-7a11cb5933ce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.396193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6594c60-a35d-4d77-9c5e-ae0504a4e4e0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.449933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.450977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.451264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.451834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.468107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8b23da03-1ff1-4b56-8465-5acc7c0e7d13 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:40.474399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:40.475537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:40.476564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 200/402] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:40.478214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.478214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.478472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.496206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:40.514426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:40.516292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:40.521597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde66734-a6c1-4341-841f-7a11cb5933ce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.565260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706478a-027a-4215-944a-0efb59384351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.566269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706478a-027a-4215-944a-0efb59384351 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.566779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706478a-027a-4215-944a-0efb59384351 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.567255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706478a-027a-4215-944a-0efb59384351 None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.568702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706478a-027a-4215-944a-0efb59384351 None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:40.570944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706478a-027a-4215-944a-0efb59384351 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:40.580187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 203/403] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:40.581713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706478a-027a-4215-944a-0efb59384351 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.597482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:40.608224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 201/404] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:40.609533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.786080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706478a-027a-4215-944a-0efb59384351 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.818345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e556f4-d457-409b-9b30-bb83714761bd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:40.859658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.860647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.861129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.861631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.861813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:40.862387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:40.862666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:40.862937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:40.863611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:40.863939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:40.864177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:40.865300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:40.866039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:40.868448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 202/405] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:40.877018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.879612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 204/406] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:40.892897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:40.921972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:40.964288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:41.021064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d788d-4bc6-4323-93aa-99481dbdc385 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.024834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa4fc5-4931-4dec-bde5-8857f9f63c8d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.058570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.059486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.059954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.060391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.061683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.063294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.065438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 205/407] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:40 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:41.066479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.069475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.071333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.071632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.071946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/groups/70968c9c20b84b87a2612856d6b755ae/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.074596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, group_id=70968c9c20b84b87a2612856d6b755ae, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.076101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.099844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 203/408] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 23 23:07:40 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/groups/70968c9c20b84b87a2612856d6b755ae/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:41.101133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.225711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:41.253321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93cb37-f9a7-4518-a3bf-b3af6114e966 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.305611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.306275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.306594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.306873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.312964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd6fbb-269b-4f2f-85f3-d37e8604f2ad None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.324171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:41.332169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:41.333079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:41.333899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:41.336854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 206/409] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:41.343863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.348675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:41.367837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.368918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.369335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.369714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.371442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.373508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.376076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 204/410] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:41 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:41.382258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.507678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec3542-15d2-4f4c-8545-832a22b32b77 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.539270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77daa81b-ded8-4b20-8916-c2b18a2535b9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.555077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.555694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.556000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.556276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.557804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:41.558266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.561298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3036-2cfa-4ba2-b1db-bd855a25404b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.578334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 207/411] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:41.578334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccab92-fa63-4f1e-a3e7-003a79c3a37b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.578334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccab92-fa63-4f1e-a3e7-003a79c3a37b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.578334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ccab92-fa63-4f1e-a3e7-003a79c3a37b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.578334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 208/412] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:41.579250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccab92-fa63-4f1e-a3e7-003a79c3a37b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.582699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:41.597175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.598032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.598429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.598810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/groups/70968c9c20b84b87a2612856d6b755ae/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.601194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] RBAC: Authorizing `identity:create_grant(project_id=bf73bc3bdc544c4594f9879a54d36e81, group_id=70968c9c20b84b87a2612856d6b755ae, role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.602743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1496f91f-3195-4c06-b0f2-f31d0854de04 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.618712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 205/413] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 23 23:07:41 2022] PUT /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81/groups/70968c9c20b84b87a2612856d6b755ae/roles/6cc679021d904431823a4fe019f8ddcb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:07:41.621009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.621377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.621733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.647532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:41.648989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:41.709893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ccab92-fa63-4f1e-a3e7-003a79c3a37b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.719699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:41.758965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.760689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.761519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.764129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] PATH_INFO: `/v3/groups/b86f644aaa214272a4452e01de6bdbe8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.767251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] RBAC: Authorizing `identity:get_group(group_id=b86f644aaa214272a4452e01de6bdbe8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.767847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 206/414] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:41.769680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.772052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 209/415] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:41 2022] GET /identity/v3/groups/b86f644aaa214272a4452e01de6bdbe8 => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:41.778177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:41.903349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81fa87-2440-4a2f-9a44-f7123c7ab417 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:41.942090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:41.943077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:41.943541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:41.944015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] PATH_INFO: `/v3/projects/d2adca37f0d3413e86c54f533079bbbf` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:41.945318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d2adca37f0d3413e86c54f533079bbbf)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:41.946998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:41.949886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 207/416] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:41 2022] GET /identity/v3/projects/d2adca37f0d3413e86c54f533079bbbf => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:41.956855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:42.053618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:42.091048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee7d1f-a5de-4e59-a525-b1b17b47ccbb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:42.128718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:42.129728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.130238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.130686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] PATH_INFO: `/v3/projects/d2adca37f0d3413e86c54f533079bbbf/groups/b86f644aaa214272a4452e01de6bdbe8/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.132801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=d2adca37f0d3413e86c54f533079bbbf, group_id=b86f644aaa214272a4452e01de6bdbe8, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:42.134435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8dd5e-68ff-46a9-a04b-17f7f1066f16 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:42.168526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 210/417] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 23 23:07:41 2022] PUT /identity/v3/projects/d2adca37f0d3413e86c54f533079bbbf/groups/b86f644aaa214272a4452e01de6bdbe8/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:07:42.183569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:42.271913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:42.353018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6685e865-6ead-4b56-917f-453bbef212c8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:42.398884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18560ae-9789-445f-af53-9906f808ece1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.399176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18560ae-9789-445f-af53-9906f808ece1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.399457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18560ae-9789-445f-af53-9906f808ece1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.401792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 211/418] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:42.407196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:42.407389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.407647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.407948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.408046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.408234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.408513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.420772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:42.427065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:42.428039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:42.428862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 208/419] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:42.434586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:42.439741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:42.441278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:42.569255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 212/420] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:42.599793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88486046-ff94-4754-850a-fd8b8caac844 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:42.612200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:42.637111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:42.637788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.638079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.638357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.639036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:42.639345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:42.640760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:42.649822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 209/421] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:42.658914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:42.739478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:42.798968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac3b46-74ab-4196-a91c-4122f1721161 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:42.840546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:42.841831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:42.842129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:42.843856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:42.886767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:42.921672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:42.923166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:42.996209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.032903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 213/422] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:43.040656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.115576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e3264-af9a-43d4-9bf0-de2b53a0afba None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.164603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be30b4-bdc6-4add-b47f-c145cb96bf5e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.205141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.205923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.206219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.206503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.207801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:43.209282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:43.211296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 214/423] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:43.217876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.232469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.233125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.233412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.233693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.272383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:43.278497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:43.279434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:43.280894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 210/424] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:43.282099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.288663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.334190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd75a1-e68d-41c4-be33-e07c6be5d845 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.384278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.418269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.418828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.419109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.419379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.421832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:43.423386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:43.427577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 215/425] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:43.431063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.494237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555649c8-750d-4301-ba11-ab5f0cbf75dc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.531569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.532217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.532499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.532770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.533508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:43.533866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:43.535250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:43.544531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 211/426] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:43.555416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.640160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.669856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274c8a9-4a3f-4cf7-b227-e245f304058b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.684951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd4e32-ec7e-4fb0-b11b-777a795348fa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:43.701063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.724647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.725263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.725544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.725817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.760504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:43.761439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.761729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.762000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.765863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=f93427a005164aa5b7b1532ba195f5b1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:43.771888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:43.773426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a153ee3-6e53-4e93-8355-2ba62aa8e88e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:43.789950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 216/427] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 611 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:43.791316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86b4c-db2b-4f31-9593-a1cec5adb58d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.791709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86b4c-db2b-4f31-9593-a1cec5adb58d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.792018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af86b4c-db2b-4f31-9593-a1cec5adb58d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.793543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 217/428] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:43.809369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c98f-3560-4d17-903d-3a57edc35e91 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:43.809705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c98f-3560-4d17-903d-3a57edc35e91 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:43.809934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c14c98f-3560-4d17-903d-3a57edc35e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:43.820965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:43.823324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:43.843927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c14c98f-3560-4d17-903d-3a57edc35e91 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:43.845795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c14c98f-3560-4d17-903d-3a57edc35e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:43.930086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:43.948382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 212/429] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:43.951792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:43.992082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 218/430] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 23 23:07:44.077932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6256b-0759-445a-8ef5-60f5e7ce3230 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.079059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6256b-0759-445a-8ef5-60f5e7ce3230 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.079532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6256b-0759-445a-8ef5-60f5e7ce3230 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.081414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 219/431] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:44.083250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0a8a-5d3b-4ec6-8e0b-daf0f8bde625 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.090536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.091292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.091788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.114422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:44.115750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:44.140145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.140798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.141085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.141361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] PATH_INFO: `/v3/projects/f93427a005164aa5b7b1532ba195f5b1` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.142514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] RBAC: Authorizing `identity:get_project(project_id=f93427a005164aa5b7b1532ba195f5b1)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:44.144482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:44.146440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 213/432] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:43 2022] GET /identity/v3/projects/f93427a005164aa5b7b1532ba195f5b1 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:44.152245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.220015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 220/433] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:44.235206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.277611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9662357-0c42-4b9e-82aa-aec83581deff None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.315168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.316190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.316669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.317136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.318435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:44.320110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:44.322577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 214/434] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:44.328571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.343514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.358050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.471119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af33b1-5230-4524-8c1d-a5ef17f4dcb6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.474914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc7bbc-a1f0-4c37-bce9-803ed9697a18 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.514550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.515206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.515626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.515944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.517042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.517866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.518287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.518880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.520109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=f93427a005164aa5b7b1532ba195f5b1) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:44.520558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:44.522414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:44.529063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:44.531601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 221/435] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=f93427a005164aa5b7b1532ba195f5b1&role.id=6cc679021d904431823a4fe019f8ddcb => generated 611 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:44.532676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c5f4b5ba-eb5a-4b4e-9b26-6acc0243010e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:44.536388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:44.537545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 23 23:07:44.538519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:44.540731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.545235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 215/436] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:44.549480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578303b1-5942-4697-aa3c-52f759690d02 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.549480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578303b1-5942-4697-aa3c-52f759690d02 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.549480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578303b1-5942-4697-aa3c-52f759690d02 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.551535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 216/437] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:07:44.552483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578303b1-5942-4697-aa3c-52f759690d02 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.671712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.694735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad5e64-cc27-45cb-8ec9-782f130e5239 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.701689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578303b1-5942-4697-aa3c-52f759690d02 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.735568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.736460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.736742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.737020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.743393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.744320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.744602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.745011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.745796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] RBAC: Adding query filter params (name=member) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:44.746209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:44.747528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:44.750420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8ad7404e-d6cc-469b-b6d1-224fdf405188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:44.755886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:44.756786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:44.763548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 222/438] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:44.764319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 217/439] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:44.764393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.764393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.764393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.764571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.784439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:44.785903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:44.830302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.866726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 223/440] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:44.873274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:44.896074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3f22d-0939-495e-b5f6-4d2072c62504 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:44.954427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:44.955053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:44.955337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:44.955617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:44.956340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:44.956646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:44.958058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:44.969643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 218/441] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:44.970727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:44.975038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.002413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78d572-7e41-403b-b3b0-1bbe318a2346 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.043707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.044357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.044644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.044924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.096623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290dadf-4739-48c3-b0ed-ba07a1ed8208 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.111625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.123625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.125139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.137576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.138445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.138906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.139357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.202693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.208794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.210269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.228563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 224/442] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:45.229480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.314165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 219/443] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:45.314933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.330069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.336487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e2310-ef03-49ef-8979-2b3a34afbde6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.371630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.372284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.372571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.372848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.383485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:45.388948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:45.389965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:45.390783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 225/444] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:45.391487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.417309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a2a5-4050-4e83-a685-9beb1d36b1ab None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.424678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.452235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.452868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.453150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.453424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.454547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.456045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.457685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 220/445] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.458443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.491717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8df48-77cf-458f-98d0-85dd964b875d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.526749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.527376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.527676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.527966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] PATH_INFO: `/v3/projects/bf73bc3bdc544c4594f9879a54d36e81` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.529099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] RBAC: Authorizing `identity:get_project(project_id=bf73bc3bdc544c4594f9879a54d36e81)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.530542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.532209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 226/446] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/projects/bf73bc3bdc544c4594f9879a54d36e81 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.532972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.544640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.565828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b3ec7-324b-4bae-96c3-f5365bda01da None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.604247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.605029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.605357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.605635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.606300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:45.606604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.607995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.616001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 221/447] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.616789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.641102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511d9a2-28b1-4368-b707-c9b95b86fd06 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.642726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.676905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.677541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.677828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.678102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.679224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.680693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.683064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 227/448] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.683744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.722603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51f80-d7dc-4b49-a40b-a5ad04726541 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.757410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a40b6-9238-4405-a597-55843186708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.758036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a40b6-9238-4405-a597-55843186708c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.758323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a40b6-9238-4405-a597-55843186708c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.758596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a40b6-9238-4405-a597-55843186708c None admin] PATH_INFO: `/v3/groups/70968c9c20b84b87a2612856d6b755ae` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.759733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a40b6-9238-4405-a597-55843186708c None admin] RBAC: Authorizing `identity:get_group(group_id=70968c9c20b84b87a2612856d6b755ae)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.761351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a40b6-9238-4405-a597-55843186708c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.763090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 222/449] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/groups/70968c9c20b84b87a2612856d6b755ae => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.763679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a40b6-9238-4405-a597-55843186708c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.779945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.796495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb619d43-7fdc-4617-a97b-4c176aed41ea None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.831353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.831918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.832199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.832497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.865902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a40b6-9238-4405-a597-55843186708c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:45.872360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:45.900814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:45.901426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:45.901712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:45.901987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:45.902720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=68313c4b2f044fd184b6941eae76cd3a, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:45.903033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.903233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:45.904506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.904836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:45.910294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 223/450] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=68313c4b2f044fd184b6941eae76cd3a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:45.911084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:45.998015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:46.030650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8322c5d8-207f-43da-8019-b7e51164e643 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:46.045900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 228/451] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:46.046877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:46.072547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:46.073273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:46.073564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:46.073848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:46.074595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] RBAC: Adding query filter params (group.id=70968c9c20b84b87a2612856d6b755ae, role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=bf73bc3bdc544c4594f9879a54d36e81) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:46.074911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:46.076425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:46.083873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 224/452] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:45 2022] GET /identity/v3/role_assignments?group.id=70968c9c20b84b87a2612856d6b755ae&scope.project.id=bf73bc3bdc544c4594f9879a54d36e81&role.id=6cc679021d904431823a4fe019f8ddcb => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:46.129659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:46.164916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9db46-9536-4d62-92dd-241da0a0f152 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:46.203030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:46.203685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:46.203998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:46.204270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] PATH_INFO: `/v3/projects/d2adca37f0d3413e86c54f533079bbbf` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:46.205453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] RBAC: Authorizing `identity:get_project(project_id=d2adca37f0d3413e86c54f533079bbbf)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:46.206914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:46.208846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 229/453] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:07:46 2022] GET /identity/v3/projects/d2adca37f0d3413e86c54f533079bbbf => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:46.215144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:46.328788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3c07d3-c0eb-4990-8427-ab7bd85173b1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:46.363800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:46.364433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:46.364722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:46.364998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] PATH_INFO: `/v3/groups/b86f644aaa214272a4452e01de6bdbe8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:46.366129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] RBAC: Authorizing `identity:get_group(group_id=b86f644aaa214272a4452e01de6bdbe8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:46.367587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5031148-b86f-4145-9a4a-916e9ae6db16 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:46.369237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 225/454] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 23 23:07:46 2022] GET /identity/v3/groups/b86f644aaa214272a4452e01de6bdbe8 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:46.375199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:46.484408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f16b4-7e2b-427f-b4bb-ef1c13ad0550 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:46.518905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:46.519508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:46.519818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:46.520098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:46.520828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] RBAC: Adding query filter params (group.id=b86f644aaa214272a4452e01de6bdbe8, role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d2adca37f0d3413e86c54f533079bbbf) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:46.521139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:46.522584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53d970-803f-42c5-9c7a-8b2a94d7c74e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:46.528814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 230/455] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 23 23:07:46 2022] GET /identity/v3/role_assignments?group.id=b86f644aaa214272a4452e01de6bdbe8&scope.project.id=d2adca37f0d3413e86c54f533079bbbf&role.id=fa42eaf240474f4086e94c0d56757850 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:49.022950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8869d-d319-4106-8a9f-8fb22fb12703 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.023479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8869d-d319-4106-8a9f-8fb22fb12703 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.023479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8869d-d319-4106-8a9f-8fb22fb12703 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.025287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 226/456] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:49.030906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.031378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.031485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.041473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:49.058833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:49.060065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:49.091555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec14b-5159-4507-bf83-9ef1c73ee9fa None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.092209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec14b-5159-4507-bf83-9ef1c73ee9fa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.092691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ec14b-5159-4507-bf83-9ef1c73ee9fa None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.094563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 227/457] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:49.104740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6e95-5ca2-4c2a-a8cb-7fabc3ee011d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.105430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6e95-5ca2-4c2a-a8cb-7fabc3ee011d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.106011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd6e95-5ca2-4c2a-a8cb-7fabc3ee011d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.137712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-33fd6e95-5ca2-4c2a-a8cb-7fabc3ee011d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:49.138924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33fd6e95-5ca2-4c2a-a8cb-7fabc3ee011d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:49.144276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:49.163586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 231/458] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:49.262074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 228/459] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:49.489752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:49.600886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b56a26-64d4-4097-86c7-ad9993c23fb4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:49.650683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:49.655869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:49.656919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.657535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.658152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.671644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:49.673114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:49.673552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ba35-16e1-4037-a970-a29d61fe03e1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.673996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ba35-16e1-4037-a970-a29d61fe03e1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.674459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d18ba35-16e1-4037-a970-a29d61fe03e1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.676142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 229/460] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:49.681471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.681756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.682261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:49.697585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:49.698562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:49.699438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:49.699438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:49.699438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:49.701466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 232/461] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:49.702411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:49.704404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:49.705862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:49.783844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 230/462] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:49.788724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:49.843342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc56ed90-fc50-4db1-b16c-21fb00c44e41 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:49.873648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:49.887397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:49.888343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.888800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.889327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.902517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:49.904770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:49.918356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb30e564-bd06-4552-903f-290201d44bbf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-38b34f0d-4c90-45ed-8d34-e6d235210253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:49.924208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:49.925137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:49.926052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:49.926052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:49.926052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:49.928656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 233/463] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:49.930345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f71e-2b62-4ff5-add9-eac320a09b4f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.930891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f71e-2b62-4ff5-add9-eac320a09b4f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.931417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176f71e-2b62-4ff5-add9-eac320a09b4f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.933346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 234/464] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:49.939067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176f71e-2b62-4ff5-add9-eac320a09b4f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:49.958278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:49.959201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.959492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.959855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.960522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:49.960825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:49.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0bb133-5399-4649-b08a-7ba61741469f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:49.980264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 231/465] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:49.985604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:49.985924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:49.986235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:49.994927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.007215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:50.008438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:50.085415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176f71e-2b62-4ff5-add9-eac320a09b4f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.107797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 232/466] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:50.107797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.135156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.136167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.136523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.136868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.137729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:50.138222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.139697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.153972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 235/467] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:50.155711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.174133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.227250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdedc5f-2899-43e0-a4f3-191c55d476fb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.273447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.277131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.278693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.279301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.279609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.280424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.281626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8017ee-0d0f-45be-8f3e-8689a44bc7af None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.282066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.319787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 233/468] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:50 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:50.319787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.339780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.340763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.341259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.341721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.361001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.362791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:50.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:50.402767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:50.403609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:50.403609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:50.403609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:50.413683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 236/469] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:50.426297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.458336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a556a-e573-43e1-9d18-e703290e6548 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.476310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.505447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.506076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.506436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.506721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.507378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.508965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.533558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 234/470] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:50 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:50.534406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.555973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cede9-5207-4fcd-84ff-4314a794f564 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.605991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.606217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.606465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.606625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.621976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.623589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.636826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-78c30919-3a4c-4351-9ef8-081fc3d16d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:50.644883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:50.646076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:50.647133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:50.647133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:50.647133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:50.648190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 237/471] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:50.649452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c695-2fc7-4886-b3d5-0ee08219a190 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.649746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c695-2fc7-4886-b3d5-0ee08219a190 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.650024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869c695-2fc7-4886-b3d5-0ee08219a190 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.652511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 238/472] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:50.656798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869c695-2fc7-4886-b3d5-0ee08219a190 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.697305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8bff3-389b-4097-94da-d7542464fa10 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.745037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.745752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.746106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.746391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.747050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:50.747364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.748866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3603e45b-67bd-4ea8-aed7-d104596fe8f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.765241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 235/473] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:50.766653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.767114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.767400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.790155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:50.792225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:50.796561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869c695-2fc7-4886-b3d5-0ee08219a190 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:50.829005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:50.841709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:50.842624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:50.842913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:50.843193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:50.844632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:50.847970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:50.850455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:50.869694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 239/474] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:50.871035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.897674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 236/475] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:50.898688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:50.956238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:51.024414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600f58f-cb0b-4986-9fa9-aa3df21bb36f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:51.079792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e390a-f61c-4fd2-a6c7-53f004035871 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:51.113882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:51.115228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:51.115812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:51.116310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:51.117156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:51.118907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:51.130694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:51.131196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:51.131480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:51.131773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:51.132563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:51.134286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:51.183378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 237/476] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:50 2022] POST /identity/v3/users => generated 249 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:51.183787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 240/477] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:50 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:51.462033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:51.490506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:51.618535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2026c3-dae2-4d4b-8f4f-531345f1c7fa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:51.661439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:51.662213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:51.662658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:51.662940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:51.663690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:51.665376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:51.676261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:07:51.676261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 23:07:51.676261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [parameters: {'id': '7376f98e9ba547d0ae3a6584b77db98d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 23:07:51.676261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 23 23:07:51.695532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return ref.to_dict() Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:07:51.696476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:07:51.698413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:07:51.699271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:07:51.701442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:07:51.703147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'id': '7376f98e9ba547d0ae3a6584b77db98d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:51.704256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 23 23:07:51.705233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:51.706296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 238/478] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 23 23:07:51 2022] POST /identity/v3/roles => generated 144 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:51.712326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:51.832593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357efe6-0c82-4e75-af5a-72dc46170eeb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:51.854074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:51.870995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:51.872349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:51.873093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:51.873861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:51.887915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ea206100-95f2-4faa-be3e-0fabf0ec341e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:51.893934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:51.894917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:51.895729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 241/479] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:07:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:51.903342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:52.016852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:52.021113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e227f-adf4-4f5e-96aa-bd124690d92f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:52.062649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28808098-2f2f-481f-9525-33643441c563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:52.063278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808098-2f2f-481f-9525-33643441c563 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:52.063685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808098-2f2f-481f-9525-33643441c563 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:52.063996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28808098-2f2f-481f-9525-33643441c563 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:52.064746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28808098-2f2f-481f-9525-33643441c563 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:52.065062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28808098-2f2f-481f-9525-33643441c563 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:52.066564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28808098-2f2f-481f-9525-33643441c563 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:52.075872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 239/480] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:52.800050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b6be-bed7-4e1e-83d9-dd8e198b8f37 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:52.800562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b6be-bed7-4e1e-83d9-dd8e198b8f37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:52.800669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8887b6be-bed7-4e1e-83d9-dd8e198b8f37 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:52.801926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 242/481] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:52.808411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf466ef-bf3a-4c84-996e-13b57077e63d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:52.808867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf466ef-bf3a-4c84-996e-13b57077e63d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:52.808941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf466ef-bf3a-4c84-996e-13b57077e63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:52.836809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ecf466ef-bf3a-4c84-996e-13b57077e63d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:52.838199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ecf466ef-bf3a-4c84-996e-13b57077e63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:52.930792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 240/482] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:07:53.026971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ea8e-d4c5-4394-99ff-6f3a306136eb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.027294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ea8e-d4c5-4394-99ff-6f3a306136eb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.027532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8ea8e-d4c5-4394-99ff-6f3a306136eb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.028927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 243/483] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:53.034738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.035029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.035311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.060822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:53.062043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:53.146141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 241/484] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:53.266827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8ea8e-d4c5-4394-99ff-6f3a306136eb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:53.408538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8ea8e-d4c5-4394-99ff-6f3a306136eb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:53.462343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:53.463538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.463836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.463940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:53.464113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.467504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:53.495919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:53.505226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:53.506144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:53.506963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:53.507570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 244/485] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:53.517584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:53.632126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:53.705883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffe63a-a688-40cd-87ef-38f6aca5b807 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:53.750780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:53.752107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.752615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.753091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.765309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-21649684-8e87-40fa-9686-fad7cfb7517a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:53.770584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:53.771491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:53.772316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:53.774941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 242/486] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:07:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:53.777122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a249-d944-4fa7-84ef-444831ff4db2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.777618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a249-d944-4fa7-84ef-444831ff4db2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.778088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79a249-d944-4fa7-84ef-444831ff4db2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.783729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 243/487] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:53.784772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79a249-d944-4fa7-84ef-444831ff4db2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:53.800889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29203e69-7ba9-4618-9abb-a248ba0ca843 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:53.856942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:53.857645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.857931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.858208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.859178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:53.859490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:53.861802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8ea94-c6f7-4b95-84f6-c4bd57d58e5e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:53.862924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:53.877886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 245/488] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:53.879440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.879735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.880038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.906020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:53.907962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:53.914567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79a249-d944-4fa7-84ef-444831ff4db2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:53.955584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:53.956387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:53.956612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:53.956986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:53.957673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:53.957976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:53.959379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:53.970030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 244/489] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:53.971052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.001990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 246/490] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:54.002855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.033430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.124400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f42bc-6d6f-4ac8-a511-f14cd6096d8d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.127919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003c892e-1ce9-4d08-a4c7-6a20875a4f7e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.158562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.171963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.172689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.173201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.173539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.176599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.177253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.177541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.177820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.185791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.187331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.189573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.191154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-27a2e9c5-4606-407e-9fe3-a5104ee62653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:54.202292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.204463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:54.206590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:54.206590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:54.206590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:54.211785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.214101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:54.215588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:54.215588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:54.215588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:54.216017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 245/491] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.216146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 247/492] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.216146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.216294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c807-b2c4-4912-b374-93f2a99c50bd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.216294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c807-b2c4-4912-b374-93f2a99c50bd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.216294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835c807-b2c4-4912-b374-93f2a99c50bd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.216294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 246/493] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:54.219843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.219843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.220095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.241707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:54.243096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:54.302120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.324440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 247/494] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:54.324726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536dd7c6-05eb-49fc-b7a8-d2403aff1920 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.325831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.365875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.366495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.366778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.367055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.367717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:54.368055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.369476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.383463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 248/495] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:54.388219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.447717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e32b7-36ae-45ef-859e-581a1cace661 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.457331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.505791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b077e5b0-bb06-4082-988a-3eca0e757256 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.510242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.511701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.512531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.514874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:54.515894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.519022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.543599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.544099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 248/496] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:54.544431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.544677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.544921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.546756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.559412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.562443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:54.569164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.570934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:54.574342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:54.579202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 249/497] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.580609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.685502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1407dd02-8309-4131-a1b6-458a0d1cc281 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.716201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcaeb50-271f-4c32-97c8-b5a8b54be7d9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.722931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.723568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.723874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.724146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] PATH_INFO: `/v3/users/glance` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.732589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.733946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:07:54.747211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.748316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 249/498] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.749203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.760197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.760833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.761122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.761892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.769282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.770711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.781601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:07:54.784342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.785247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:54.786159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 250/499] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.786761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.853019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:54.873381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79174f3-56d7-4c10-b012-c7f46d4a95db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.900554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d958084-e58c-4158-bf99-34a3dbb30a2a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:54.912327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.912941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.913219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.913487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.914145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:54.914447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:54.916628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:54.931806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 250/500] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:54.932829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:54.945938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:54.946369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:54.946657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:54.947032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:54.959677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:07:54.966980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:54.967956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:07:54.968876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:54.971901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 251/501] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:54.972927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.068001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.081798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a600-9888-4c1c-81d6-ba103cf8a0f5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.084511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16d455-ef66-45e2-85ae-b6b1f704da93 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.105890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.117635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.118246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.118526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.118884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.120163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:55.120467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.121531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.121910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.122125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.122404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.122682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.123407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:55.123939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.125372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.159699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 251/502] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:55.160575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.171188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 252/503] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:07:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:55.171188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.271026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680bc2f-b7d8-4560-ab45-9bb491d75860 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.285542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6b4f8d-62b5-40dc-8628-486640061b92 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.305079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.305690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.305975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.306286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.306968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:55.307258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.308684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8fe53c-bfb0-484c-8482-7a0e6008f6c4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.316991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 253/504] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:55.318184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c39b-f99e-4ab4-86f2-ee69fc500c5c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.318466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c39b-f99e-4ab4-86f2-ee69fc500c5c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.318739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6226c39b-f99e-4ab4-86f2-ee69fc500c5c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.319955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 254/505] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:55.320641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226c39b-f99e-4ab4-86f2-ee69fc500c5c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.328379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.329028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.329312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.329586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.340962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.342441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.349539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:55.358355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:55.359363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:55.360245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:55.360245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:55.360245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:55.360245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 252/506] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:55.360481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.373300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.434942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6226c39b-f99e-4ab4-86f2-ee69fc500c5c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.461469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a3657-50a9-416e-81a2-8c92214e2b6b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.470625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.471241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.471522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.471822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.497917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.498535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.498821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.499096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.548335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.549747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.591648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.593353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.597545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.599700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587fb444-ed35-44a7-88af-4a31ec00d0c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.658707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 255/507] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:55.659569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.706217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 253/508] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:55.707490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.707811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.708085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.726522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:55.727743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:55.759092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29124969-262d-4901-8809-dc3eca2827bf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.793741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 254/509] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:07:55.794606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.794779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.795318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.795624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.795914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.804836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.809388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.811850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:55.832245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:55.833699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:55.835423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:55.835423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:55.835423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:55.835423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 256/510] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:55.835423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.836974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:55.929807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061ddbc-ac3c-4f3b-b585-511d7027a77c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.950812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46a5e-5043-4de2-b61b-b4fdee60bcca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:55.969141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.969754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.970033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.970303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:55.970949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:55.971249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:55.972679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:55.988959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 255/511] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:55.988959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:55.990996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:55.991634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:55.991949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:55.992221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.004682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.006129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:56.021256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.022354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:56.023205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:56.023205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.023205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:56.023205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 257/512] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.023205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.075942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.088802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.100951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5368e-893d-4de3-b8e8-bd13b241b9c4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.132881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f784cf-d2b0-4415-9c92-b8ac9d4f03ad None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.135200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.135897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.136213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.136421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.148689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.150548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:56.166362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.167723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:56.168877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:56.168877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.168877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:56.168877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 256/513] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.168877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.179393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.180049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.180332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.180608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.181321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.182133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.183575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.195646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 258/514] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.196503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.270859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40936f4-8dbe-4cd3-9231-83c42a0d9866 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.295500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0861c-0c11-4a18-a1cb-336fa03ed2cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.297878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.305523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.306155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.307082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.307423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.315208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.316702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.319216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:07:56.329451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.330505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 257/515] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.331438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.332310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.332508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.332787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.333059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.333708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.334007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.335379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.347436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 259/516] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.348322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.437227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf809d8-e4e5-484f-9651-2bc20d674dda None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.448950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b20f318-5365-4893-a9d6-978e9f2f7a19 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.471505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.472389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.472680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.472964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.483043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.483656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.483969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.484245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.484896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.485201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.485758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.486595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.487220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.499409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 260/517] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.500258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:56.504530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.505555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:56.506402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:56.506402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:56.506402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:56.506402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 258/518] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.506402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.530221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.564452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.607112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec372275-2d9f-42b7-abec-2d734b2cd086 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.614001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b0508-06e6-434a-949a-61e7e61868f8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.644275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.644903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.645187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.645461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.647465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.648110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.648398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.648672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.649405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.649739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.651915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.653421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.654865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:07:56.667688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.668693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 261/519] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.669583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.670984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 259/520] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.670984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.757064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.771109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2ac927-95c4-4ad2-a942-1faf8f6bf98e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.773327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af99bc46-49f0-426a-9b4d-3918a6625d30 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.782689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:56.805824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.806490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.806769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.807038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.807347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.808000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.808282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.808554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.813733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.815069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.815213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.816522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:07:56.827746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.828672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:56.829692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 260/521] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:07:56.830171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:56.830938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:56.831850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:56.832274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.832350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 262/522] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:56.832350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.934040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee16b4-6012-4fb9-960a-4b933d25c6db None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.935547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040e45c4-7027-4171-a6c5-959aaaefc771 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:56.969864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.970114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:56.970559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.970669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:56.970755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.970918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:56.971003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.971083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:56.971618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.971778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:56.971971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.972123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:56.973466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.973567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:56.985763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 261/523] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.986386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:56.994330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 263/524] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:56.994869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.001241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.017296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.090506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119b9a05-e2a1-4421-836d-61064d743094 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.100484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffb5b8-ac26-4a35-badc-3ee57da8c00b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.126772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.127388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.127672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.127986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.135575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.136216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.136503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.136779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.137479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:57.137790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.139244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.157705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 264/525] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:57.158524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.196736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.198197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.221867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.233407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.261567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a29be-318f-4559-aaf6-a6b0301d89ab None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.297723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.298340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.298627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.298906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.299613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:57.299955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.301409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.304370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 262/526] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:57.305202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.313839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 265/527] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:57.314773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.423558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38ea5a-52a1-49dd-addd-e8b73142f15e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.438370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3103c-8022-441c-970d-930e3bf99e26 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.453981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.459645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.460313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.460596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.460876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.463862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.465096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.465672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.486254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.486894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.487179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.487453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.499083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 263/528] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:07:57 2022] POST /identity/v3/users => generated 247 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:07:57.499986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.584786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.586413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.644448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2a545-29ef-4969-bf56-bf073abe8d94 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.691000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.691000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.691000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.691000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.691464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:57.691464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.693433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.701056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 264/529] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:57.702112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.716176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 266/530] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:07:57.717210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.771622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.776560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:57.842870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77dd7e-f617-46ad-8f5e-7ff2803c50c1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.845414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b0f0d8-0d30-421c-9f01-f2ab5413f0c1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:57.882169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.883406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.883868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.884880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.885886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=b95d02dc83464209b536460b970d024b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:57.886428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.887585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:57.888254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.888382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:57.888552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:57.888829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:57.895747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 267/531] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/role_assignments?user.id=b95d02dc83464209b536460b970d024b&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:57.896814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:57.916636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:57.918405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:57.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:57.951359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:57.952479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:57.952479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:57.952479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:57.957450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 265/532] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:57.963332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.012433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.045907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1243c-74dd-455a-88e5-ca914d457691 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.132358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004a09b-7a7e-4623-bde0-55aa9ca13aaa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.135319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.148366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.149020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.149301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.149576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.162473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.163971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:07:58.179367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:58.182016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:07:58.184082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:07:58.184082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:07:58.184082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:58.184082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 268/533] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:07:58.189418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.212577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.213478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.213905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.214688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.215632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:58.216325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.218238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.233891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 266/534] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:58.239065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.343896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ac36c-4d16-425f-9d2b-5c18a907261b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.370280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba0bd52-77fd-4c9e-8eb4-ec7370f145f0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.379817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.379817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.380098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.380362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.381020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:58.381320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.382697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.392510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.397368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 269/535] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:58.403562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.443350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.444652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.445694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.446049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.454305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.455903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:07:58.469903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:58.470969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:58.472053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:07:58.473938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 267/536] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:58.480295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.516885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.637443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0102-603c-480e-a8db-51929cde4d34 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.643979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d24c64-5587-4824-9677-3439f330f1ae None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.708991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.709725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.710494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.710835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.713907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:58.713907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.714776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:58.715473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:58.715840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:58.716303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:58.717569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.736622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:58.738200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:58.754313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 268/537] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:07:58.761040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:07:58.762059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:07:58.762978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:07:58.763795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 270/538] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:07:58.765636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.770103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:58.877255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.948364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:58.960179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e473552-5e82-4b2e-8de8-809723d2b3c5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:58.981444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54c413-c802-46bd-8e1b-3433fb1b9123 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:59.016727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:59.017365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.017614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.017892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.018637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:59.018951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:59.020417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:59.046758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 271/539] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:59.049369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:59.049983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.050264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.050541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.051275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=e8335dd9c12b44f885d60cff8f59e55a) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:59.051587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:59.053055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3aa8b-9660-44f2-a038-22cdc272a21f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:59.054858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:07:59.068160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 269/540] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:58 2022] GET /identity/v3/role_assignments?user.id=e8335dd9c12b44f885d60cff8f59e55a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:07:59.206978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a645f8-4b95-4173-a28b-ac70e09013c2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:07:59.229369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:07:59.248345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:07:59.248964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.249246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.249522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.250262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=bea41ec6a516482e89cbcd12344250e4) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:07:59.250575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:07:59.252317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84f583-6e35-4e5e-b7eb-1e900dddbe2d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:07:59.258413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 272/541] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:07:59 2022] GET /identity/v3/role_assignments?user.id=bea41ec6a516482e89cbcd12344250e4&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:07:59.886720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d345-7402-4800-9c19-dd8c3673f055 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.887125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d345-7402-4800-9c19-dd8c3673f055 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.887302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660d345-7402-4800-9c19-dd8c3673f055 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.888916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 270/542] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:59.894488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3088b-d8a4-4e57-bf16-1b13720ce966 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.894783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3088b-d8a4-4e57-bf16-1b13720ce966 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.895058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3088b-d8a4-4e57-bf16-1b13720ce966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.898822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad22ed-b7aa-4f76-949d-5f5d9be7dbcb None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.899367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad22ed-b7aa-4f76-949d-5f5d9be7dbcb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.899921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ad22ed-b7aa-4f76-949d-5f5d9be7dbcb None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.901975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 271/543] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:07:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:07:59.908114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d30f-b248-4b1b-af37-a869fc07f933 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:07:59.909680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d30f-b248-4b1b-af37-a869fc07f933 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:07:59.910174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127d30f-b248-4b1b-af37-a869fc07f933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:07:59.934977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-6ce3088b-d8a4-4e57-bf16-1b13720ce966 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:59.936426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-6ce3088b-d8a4-4e57-bf16-1b13720ce966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:07:59.949415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2127d30f-b248-4b1b-af37-a869fc07f933 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:07:59.950625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2127d30f-b248-4b1b-af37-a869fc07f933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:00.085524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 273/544] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:00.095498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 272/545] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:08:00.406087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321d06d-4140-4774-9003-62f6930c6220 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:00.407148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321d06d-4140-4774-9003-62f6930c6220 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:00.407998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321d06d-4140-4774-9003-62f6930c6220 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:00.411219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 274/546] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:00.417103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:00.417439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:00.417792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:00.444807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:00.446036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:00.520097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321d06d-4140-4774-9003-62f6930c6220 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:00.561070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 273/547] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:08:00.606566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:00.616127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:00.758300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321d06d-4140-4774-9003-62f6930c6220 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:00.772466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dc80c-8ca7-4323-9652-90ae9f80a921 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:00.786941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:00.838391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:00.839105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:00.839489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:00.839899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:00.842467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:00.843236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:00.843528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:00.843925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:00.867954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:00.874687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:00.875895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:00.877137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 274/548] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:00.879204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:00.888033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:00.890718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:00.893236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:00.895299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:00.895532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 275/549] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:00.903160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:00.974737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.016252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886068a8-bc34-4177-800f-dd1aaf397e8a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.027503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5c814-d8dc-4700-b68d-8f46bf080ea7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.057199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.058624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.059228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.059742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.060856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:01.061423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.063616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.066625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.067247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.067881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.067881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.068499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:01.068808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.070277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.082055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 275/551] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:01.082055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.082999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 276/551] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:01.089067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.135725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.202360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdfc24-9f18-4e4b-9239-68c469813989 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.225801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f5303-fdca-4da6-b49f-6e8a6f2a6997 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.233405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.243112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.244116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.244588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.244931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.257788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:01.263541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:01.265069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 276/552] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:01.266215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.280524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.281378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.281802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.282303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.294789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.296633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:01.312784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:01.313916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:01.314787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:01.314787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.314787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:01.321387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 277/553] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:01.322900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.384865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9642-f31c-46b5-8e8f-1c6acdad3d24 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.422275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.422858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.423143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.423401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.435477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.437024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:01.453104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:01.454993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:01.456924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:01.456924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.456924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:01.458909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 277/554] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:01.459773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.496083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.508145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.517388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c143509-3ed9-4699-97f2-834a7b6f7a01 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.569012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.570508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.571292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.572460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.573991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:01.574991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.577963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.590486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08f2c-7e83-4733-8349-7d50ad5ebd81 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.594725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 278/555] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:01.596494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.632709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.633330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.633612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.633888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.634708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:01.635018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.636621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3ccaa-4e6f-4f5c-ac3a-a2cd782ee33f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.652597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 278/556] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:01.654001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b64ac-a29c-4e2b-909f-4c05f750138e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.654291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b64ac-a29c-4e2b-909f-4c05f750138e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.654621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b64ac-a29c-4e2b-909f-4c05f750138e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.659902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 279/557] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:01.659902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b64ac-a29c-4e2b-909f-4c05f750138e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.756579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9613-98e3-4785-8c5e-437ed1948624 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.785096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.789776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b64ac-a29c-4e2b-909f-4c05f750138e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.798541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.799159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.799445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.799720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.800402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:01.800704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.802077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.815443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 279/558] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:01.816165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.831422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:01.836777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.837515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.837940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.838447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.849607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.851077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4b4fb312-dad7-47fc-ac34-bd96bf24aebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:01.866105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:01.873102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 280/559] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2538a-fe97-4b4e-869c-bb6bfa607f83 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2538a-fe97-4b4e-869c-bb6bfa607f83 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.876484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2538a-fe97-4b4e-869c-bb6bfa607f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.890895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4db2538a-fe97-4b4e-869c-bb6bfa607f83 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:01.892134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4db2538a-fe97-4b4e-869c-bb6bfa607f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:01.941889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6b129-1b49-431a-bfec-c96d966fc2bd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:01.968434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 281/560] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:01.969711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134549d-0bd1-40ce-ae73-c49f2e67ae55 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.970002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134549d-0bd1-40ce-ae73-c49f2e67ae55 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.970281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1134549d-0bd1-40ce-ae73-c49f2e67ae55 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.971842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 282/561] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:01.972576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134549d-0bd1-40ce-ae73-c49f2e67ae55 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:01.987452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:01.988693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:01.989107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:01.989507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:01.998172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:01.999906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:02.014502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:02.015769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 280/562] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:02.016926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.107565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.131916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.151873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f52e62-1a95-4c74-a4b3-88500ae330d3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.162369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1134549d-0bd1-40ce-ae73-c49f2e67ae55 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.199698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.200579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.201047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.201329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.201998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:02.202301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.203674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d202ed1-3d08-4128-a350-7a88db83d6c6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.209671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.210821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.211911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.212292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.223969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 281/563] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:02.223969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.223969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.223969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.226501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.228993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:02.243448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:02.245364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 283/564] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:08:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:02.246624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.252797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:02.254200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:02.325555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 282/565] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:02.326407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.378110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8077d-3145-49bf-8442-834bf033986d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.412515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.433503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.434525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.434928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.436644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.436644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:02.437199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.438794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.456113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.465412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 284/566] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:02.467709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.476254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2812dfa7-2870-47c9-aea0-4a89ee9b5f4e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.524447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.525611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.525935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.526184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.536146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.537716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:02.555152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:02.556321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:08:02.557624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:02.560945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 283/567] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:02.561803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.594971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce7953-11e4-4a1a-aaf6-f887d946f50c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.631684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.632282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.632561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.632839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.646053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:02.651345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:02.653403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 285/568] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:02.654923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.672171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33569237-da24-43a8-8934-50d67b5835c5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.688685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.708137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.708747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.709031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.709305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.710046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:02.710557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.711839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.714629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.730781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 284/569] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:02.731606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.757890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268b6f4-0ccc-417f-bab4-50bc037daabe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.794420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.795032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.795317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.795597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.837196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743f33b-3f8a-4fd5-9caf-515fab19db2f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:02.870305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.872007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.873507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:02.874119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:02.874413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:02.874802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:02.875431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:02.875743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:02.877506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:02.897021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 285/570] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:02.898252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:02.932617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.949187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:02.993465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 286/571] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:02.994331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.016468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4f448-a9fc-4b8a-b726-e7f27f00f699 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.060969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.061613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.061892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.062163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.073260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:03.078033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.079033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 286/572] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.079957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.104520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156479a-738f-4e6c-9233-5c507d750913 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.139976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.140582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.140869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.141136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.141809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.142112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.143547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.152690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 287/573] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.153436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.183115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.187588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.195016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e24a1-86fa-4733-a89e-c973a3fb4171 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.233618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.234255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.234538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.234817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.245766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.247210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:03.263580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.271831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:03.273566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:03.273566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.273566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:03.273887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e121a2-56c3-42ad-9e5a-04e91fb8d938 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.274478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 287/574] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.274478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.299963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.300714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.301027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.301298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.316332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.317807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:03.334045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.335139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:03.336241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:03.336241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.336241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:03.336241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 288/575] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.336241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.383209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d5118-4c2d-4196-b5dc-fe4406d9ee1d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.414683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.418318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.418964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.419245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.419571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.431813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.433585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.442277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.442845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b24ee3-2b43-4715-9852-7fec67f3c4cd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:03.452025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.453027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:03.454409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:03.454409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.454409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:03.454409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 288/576] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.454409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.494444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.495101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.495379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.495651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.496349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.496653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.498032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.506726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 289/577] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.507534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.574952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43e0e4-375e-494d-afc1-ec360c38252f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.609675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.610309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.610588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.610865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.613556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a9118-aabc-49c2-a786-4031f1b99338 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.622225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.623684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:03.637879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.638830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:03.639732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:03.639732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.639732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:03.639732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 289/578] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.639732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.652078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.652805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.653087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.653365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.654014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.654315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.655727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.658534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.669466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 290/579] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.670223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.692353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.746250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7006d6e7-617b-43df-8462-747cfdcefc01 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.772483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408458b-ba70-4bb1-9611-7382093d6339 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.780544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.781157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.781440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.781716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.782362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.782666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.784065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.796473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 290/580] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.797294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.809822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.810438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.810718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.810998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.811681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.812009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.813397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.824610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 291/581] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.825424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.886226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.901809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc15c3-6b88-4f89-bafd-480a782d8b6f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.912566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:03.932276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae83686-cb2c-49d8-95e6-ef492f645282 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:03.936713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.937353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.937695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.937973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.948816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.950273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:03.966239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:03.967405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:03.968862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:03.968862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:03.968862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:03.968862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 291/582] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:03.968862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:03.969977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:03.970599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:03.970878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:03.971204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:03.972110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:03.972414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:03.973831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:03.986704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 292/583] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:03.987532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.071219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3632cee-03de-4105-8186-7ff3a271a42e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.088036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6d4e5e-d7c8-48c1-ba61-243f9acf68ff None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.105172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.106688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.107135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.107422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.107721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.114594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.116114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.123863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.124500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.124785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.125063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:04.127677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:04.128741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:04.129842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 292/584] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:04.130444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.137980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.139437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:04.151184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:04.153082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 293/585] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:04.154864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.160707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.237641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8307d-f5a3-4bef-8f40-07f64fab235c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.260829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433103ce-304e-4105-b4af-a6fc21c5977b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.273897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.274543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.274884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.275687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.282487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.283973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:04.295165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:04.296245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:04.297495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:04.298016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.298016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.298528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 293/586] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:04.298528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.299954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.300261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.300937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:04.301247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.302639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.314982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 294/587] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:04.315865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.352113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.380566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.401042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498cec-5e91-4ec2-8a9c-a270ca4e0985 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.421144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8264f56-9756-4934-8a7f-c34772d6bed0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.434875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.435512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.435818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.436106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.443608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.445130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.455260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.455980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.456264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.456541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:04.456742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:04.457887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:08:04.458849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:04.459385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:04.459385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.459520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 294/588] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:04.459588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.459657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.471506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 295/589] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:04.472213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.565690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd50b7b-89ca-4cf1-97ea-4cb036765d13 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.568038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.576584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5864d1e-7957-4382-bb60-4375b2bb4f18 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.605507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.606132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.606418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.606703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.607411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:04.607726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.609259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.615101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.615851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.616134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.616407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.617122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:04.617999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.619565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.623481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 295/590] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:04.624220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.627625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.635071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 296/591] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:04.636104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.740109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032dc70-1c87-4c8c-b8f2-9822a6b80399 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.743181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2cc51-cc9d-42b0-822b-bdd0f1f9ea4a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.779548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.780218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.780498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.780777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.785736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.786342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.786621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.786894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.787623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:04.787952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.788064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.789391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.789486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:04.801195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:04.802382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 296/592] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:04.803355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.809280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 297/593] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:04.810021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:04.827388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.866472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:04.909596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b0d18-0a22-4a15-8d74-d0607d4af012 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.920104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c2e42-a797-414d-b88b-2a537f1ba929 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:04.945191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.946050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.946241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.946518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/1a36073c19844c26b5262f438257d932` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.954933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:04.955587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:04.955910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:04.956232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/b95d02dc83464209b536460b970d024b/roles/1a36073c19844c26b5262f438257d932` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:04.962605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=6aee1815f27f44e5a738eda3234595e6, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.964101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.974985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=b95d02dc83464209b536460b970d024b, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:04.976491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:04.978984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 297/594] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:04 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:04.991880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.003479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 298/595] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:04 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/b95d02dc83464209b536460b970d024b/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:05.004399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.118163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:05.129005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d33cfa-54e1-4f98-9052-742cbff0bed9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.150736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:05.169657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d29da14-df49-4226-bc1e-d0aa01502c48 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.177335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.177954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.178691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.178982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.179722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=528934c45fb140dea3dc59f2056fcd5a) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:05.180069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.183230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.192585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 298/596] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:04 2022] GET /identity/v3/role_assignments?user.id=528934c45fb140dea3dc59f2056fcd5a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:05.193451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.230131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.230761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.231047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.231323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.232216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:05.232528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.234105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.271715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 299/597] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:05.277809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.331047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a6856-5258-40ef-a09c-43d1274fac34 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.414448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.415016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.415302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.416161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.437548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.439942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:05.461190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:05.462849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:05.464333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:05.464333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:05.464333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:05.470814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 299/598] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:05.476854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.489790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05fe9c-5b01-4afc-b833-d1b9a9195245 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.524355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:05.545062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.546567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.547074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.547548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.548786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:05.578457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.579988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:05.613424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:05.614455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:05.615341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:05.615341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:05.615341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:05.627153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 300/599] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:05.639194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.749827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144d33ae-a4e3-4e25-917e-adce92ed7941 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.779587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ee539-a66e-4ada-be48-f34ad4cf47e0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:05.821249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.822469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.822867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.823211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.824023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:05.824355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.827790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.843971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 301/600] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:05.846549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.847414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189792-c36f-4afe-9725-363820874261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:05.848312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189792-c36f-4afe-9725-363820874261 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:05.848813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189792-c36f-4afe-9725-363820874261 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:05.849291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68189792-c36f-4afe-9725-363820874261 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:05.850144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68189792-c36f-4afe-9725-363820874261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:05.850662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68189792-c36f-4afe-9725-363820874261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:05.852289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68189792-c36f-4afe-9725-363820874261 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:05.866504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 300/601] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:05.885686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189792-c36f-4afe-9725-363820874261 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:05.892148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:05.968318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff463cf-9dfb-4966-a822-67957fe090be None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.006080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.007083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.007378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.007658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.016182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.018587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:06.031666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:06.032858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:06.033993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:06.039820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 302/602] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:06.041409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:06.155369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:06.160129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:06.163373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c29dd2-3c57-49bb-a3ed-be2d2f0dde57 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.193109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68189792-c36f-4afe-9725-363820874261 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.204643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.205267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.205548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.205824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.206532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:06.207311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.208824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.228145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 303/603] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:06.230180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:06.282891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.283466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.283910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.284201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.300664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.302284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:06.325091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:06.326061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:06.326966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:06.332875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 301/604] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:06.339182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:06.356017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477d4e4-34a2-4427-ad05-f8a7c4ec748c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.401168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.401810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.402099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.403264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/bea41ec6a516482e89cbcd12344250e4/roles/1a36073c19844c26b5262f438257d932` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.420204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=bea41ec6a516482e89cbcd12344250e4, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.421694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.444103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 304/605] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:06 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/bea41ec6a516482e89cbcd12344250e4/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:08:06.545301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1756e-d7aa-4bbf-9956-211efc8d7d69 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.607013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.607650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.607957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.608234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.608997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:06.609308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.610748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d8d40-d35f-41bd-b2bc-9f98477684d6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.631965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 302/606] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:06.634474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:06.640358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:06.759325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a7f02-ff12-4101-8fdd-74bcde3cb1fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:06.825615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:06.826600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:06.827079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:06.827542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/e8335dd9c12b44f885d60cff8f59e55a/roles/1a36073c19844c26b5262f438257d932` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:06.854303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=e8335dd9c12b44f885d60cff8f59e55a, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:06.856226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a64dacd-8105-4765-99f6-17b1edb43d2b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:06.880728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 305/607] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:06 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/e8335dd9c12b44f885d60cff8f59e55a/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:07.269668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2990ad3-e1b5-447f-a0e1-7f9ce52e2db6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.270397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2990ad3-e1b5-447f-a0e1-7f9ce52e2db6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.270883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2990ad3-e1b5-447f-a0e1-7f9ce52e2db6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.272494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 303/608] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:07.279116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.279727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.280256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.292174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a848-d6c1-4ce9-a39c-ac753d694b37 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.292813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a848-d6c1-4ce9-a39c-ac753d694b37 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.293302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a510a848-d6c1-4ce9-a39c-ac753d694b37 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.295228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 304/609] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:07.300763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.301324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.302469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.310722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:07.310722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:07.332617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:07.333884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:07.336117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:07.409648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:07.412483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 305/610] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:07.447549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 306/611] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:07.731085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:07.860224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab90399-000d-4c97-8473-aa8d4fb57c23 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:07.866823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:07.906939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:07.908615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.908904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.909182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.919233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:07.925387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7fff9787-952f-4950-a86c-3bb338e8ac20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:07.930770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:07.932561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:07.933426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 306/612] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:07.936290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1644cf-45f1-4353-a0b2-81292e3875b8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:07.936580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1644cf-45f1-4353-a0b2-81292e3875b8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:07.936858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1644cf-45f1-4353-a0b2-81292e3875b8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:07.939009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 307/613] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:07.939461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1644cf-45f1-4353-a0b2-81292e3875b8 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.002676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694cd8c-3e35-4283-b973-39cd874405fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.044556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.045196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.045473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.045743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.060478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cda56d46-95ab-415d-9a12-fb4eef3b7525 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:08.067645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:08.068603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:08.069468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:08.071829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 307/614] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:08.073287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.073782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.074250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.079565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1644cf-45f1-4353-a0b2-81292e3875b8 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.093055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:08.094596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:08.121373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.121900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.122182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.122487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.123186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:08.123494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.125283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.135116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 308/615] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:08.136126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.144200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.173948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 308/616] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:08.175170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.215506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.266563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0affd-7056-400d-9a3c-42f79c25a254 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.284265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867d072-c339-4865-a9c2-4ab5224c84ec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.310111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.310937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.311225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.311504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.312219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:08.312512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.313887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.323576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.324135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 309/617] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:08.324836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.325315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.325784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.329878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.337793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.339883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:08.356881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:08.357897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:08.358822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:08.358822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:08.358822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:08.361055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 309/618] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:08.366709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.408415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.472579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5350748-4f52-4657-97fc-dcb3e684de95 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.497386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f5536-33d7-45c8-a6de-7f47d6d3e2fd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.527820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.544795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.545805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.551875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.552460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.553430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:08.553948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.555556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.565408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.566068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.566354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.566630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.581617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 310/619] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:08.587977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.599474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.601322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:08.636698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:08.637733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:08.638741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:08.638741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:08.638741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:08.642143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 310/620] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:08.647912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.714629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.732899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc41e16-6524-431f-a7d5-82fce1161d66 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.762119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2b1a4-1c8e-48cc-95c2-107a844dfbdb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.773931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.774992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.775496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.776098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.785138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.787147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.798668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.799311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.799596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.799924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:08.803579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:08.804556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:08.805559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:08.808805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 311/621] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:08.810045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.813401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:08.819036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:08.820218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:08.821073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:08.827369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 311/622] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:08.828449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:08.865020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:08.934943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f793cfa-8021-4468-aa4c-2d822332cc09 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.940962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1cb7f-587b-43ef-b367-2c62c98c0343 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:08.979896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.980924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.981469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.981999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.982899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:08.983108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:08.983534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.983951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:08.984335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:08.984715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:08.985618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:08.985745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:08.986117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:08.987726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.001694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 312/623] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:09.002957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.008448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 312/624] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:08:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:09.010282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.014770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.108845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.118473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92dfe2-3e7d-458e-b7f6-a2780fb5ff6d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.118983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcffd6f-836d-4525-b891-c664db9902ff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.155296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.155514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.155960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.156238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.156384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.156495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.156843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.157170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:09.157304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.157477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.158860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.165220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.166864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.172729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 313/625] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:09.172729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3ce41998-2889-4363-ade9-aec51042d002 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:09.185507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:09.186768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:09.187876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 313/626] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:09.189214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abfee-e9f5-4eee-9c7a-2ab3c1e0f771 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.189214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abfee-e9f5-4eee-9c7a-2ab3c1e0f771 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.189214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0abfee-e9f5-4eee-9c7a-2ab3c1e0f771 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.195346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 314/627] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:09.195346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0abfee-e9f5-4eee-9c7a-2ab3c1e0f771 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.267312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.316833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461fdfd-41ce-4c73-9055-b688b0b26c26 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.324512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0abfee-e9f5-4eee-9c7a-2ab3c1e0f771 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.362641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.363261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.363546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.363854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.366586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.367312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.367659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.368034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.386005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.387480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:09.405535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:09.406589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:09.407847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:09.407847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:09.407847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:09.407847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 315/628] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:09.407847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.412696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.455351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.456841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da37fc94-c079-4503-8689-767d16a51f97 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.519945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62c37b-cfbf-40b3-ab0b-3658fd377eee None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.539813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.559408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.560071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.560386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.560653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.561373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:09.561687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.563180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4407e-87c0-4fb0-ad01-43f4eaa033eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.583608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 314/629] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:09.585009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.585321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.585586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.587636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 316/630] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:09.589251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637fa3-08ab-4978-af5e-9af502e7c320 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.589540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637fa3-08ab-4978-af5e-9af502e7c320 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.589818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99637fa3-08ab-4978-af5e-9af502e7c320 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.591346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 317/631] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:09.595743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99637fa3-08ab-4978-af5e-9af502e7c320 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.606190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:09.607428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:09.680069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.685998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 315/632] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:09.689536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.728407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99637fa3-08ab-4978-af5e-9af502e7c320 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.769301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.769911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.770378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.770597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.771367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:09.771675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.773116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.790057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 318/633] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:09.790057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:09.812671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.817124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826084-a003-41e5-9d9a-0732b73e4771 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.856572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.857221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.857499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.858054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.869265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:09.871145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e6b92536-a908-4fa5-a912-35c2811449cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:09.889290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:09.890328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:09.891267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:09.891267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:09.891267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:09.891267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 316/634] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:09.891997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.892347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.892523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.912064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:09.913013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:09.916826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb537783-8d70-427b-96ca-019b087e25b9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:09.943459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:09.958673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:09.959390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:09.959780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:09.960137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:09.994241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 317/635] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:09.995897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.042223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.043699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.092193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.114835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89629b8d-6e60-495f-8c15-10f0e11c20c0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.154135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 319/636] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:10.154135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.155426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.156232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.156519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.156787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.164322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.166645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.177129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:10.179799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:10.180732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:10.181881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 318/637] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:10.182488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.261001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cfd2f-8278-449c-ae91-909a5bb89baf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.287234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8c4a2-31bc-4d9e-be6b-7b11fdd33138 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.296326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.296873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.297159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.297448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.298102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:10.298408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.299819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.311391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 320/638] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:10.312233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.327620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.328286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.328568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.328846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.337913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.342178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:10.347575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:10.348714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 319/639] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:10.349573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.406143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.425167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b340ca-1faf-4b70-8a2c-fb25d960a952 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.450407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73c277-c4be-4ea9-9964-be8878b3b6bf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.459311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.459966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.460256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.460530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.471654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.473143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.484168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.484778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.485063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.485347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.486076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:10.486386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:10.486886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:10.487900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:10.488859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:10.488859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:10.488859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:10.489034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.489106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 321/640] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:10.489106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.508812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 320/641] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:10.510424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.569733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.601605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e730164-5e41-4c32-b63e-cc2605fcd635 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.617620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563b6c5-81f2-490f-b8e9-2e89a98822a6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.641409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.642081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.642364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.642638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.644746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.657895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:10.661195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.661840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.662114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.662386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:10.663310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:10.668560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 322/642] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:10.669435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.670206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.671307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:10.687466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:10.689146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 321/643] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:10.690329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.796308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b06e8-d5ba-46b4-ac3b-6ac92d4838c5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.821003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e2936-13ea-4f78-85e6-ca2ab279184a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.834635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.835234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.835520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.835815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.836489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:10.837169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.838682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.839996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.847269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 323/644] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:10.848283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.862828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.863439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.863721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.864021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:10.864673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:10.864978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:10.866353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:10.879658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 322/645] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:10.880686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:10.912090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:10.958762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167aef7e-5f88-4b8f-8fa9-0b32a11e4a99 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.994525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1459286c-c5d3-4788-8d41-ff516922903d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:10.995244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:10.995794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:10.996092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:10.996383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.007400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.008884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:11.023462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:11.024594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:11.025580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:11.025580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.025580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:11.025580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 324/646] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:11.025580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.034879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.035506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.035810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.036090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.036767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.037074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.038449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.047767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 323/647] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.048606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.093888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.141591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca7995-72e5-4d11-ad72-6bfc8665423f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.151297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.155821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4989b-28ae-4924-a214-fc461c824ae7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.178691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.179298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.179585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.179896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.180602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.180963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.182903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.191499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.192181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.192466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.192744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.195314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 325/648] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.196068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.205697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.207176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:11.221797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:11.222866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:11.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:11.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:11.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 324/649] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:11.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.302860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa7e98-a3ca-4ccd-a87b-c6df80477bcf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.324487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.334344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd4265-e653-455b-ac37-99cae8bb2890 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.340281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.340919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.341204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.341481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.348843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.350235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:11.365916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:11.367153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 326/650] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:11.369096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.377514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.378144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.378427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.378703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.379356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.379662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.381075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.393639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 325/651] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.394551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.398562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.476562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c303b-d6a5-4b6f-a38e-d9e1ef69e5da None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.501639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dba54-5d9a-4581-a1f5-cd9e9043aa8b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.517953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.518593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.518879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.519156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.530132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.531693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.535384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.536028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.536314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.536598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.537332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.537646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.539082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.545448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 326/652] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.546256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:11.547157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:11.548203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:11.549146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:11.549146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:11.549146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:11.549146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 327/653] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:11.549670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.574845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.658531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.685122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55277d93-e2f7-46bc-ac2e-6eddf81adfc6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.686069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc4ea87-e2d3-449a-96c4-a894408ea7ab None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.728874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.729504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.729785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.730059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.730720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.730819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.731025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.731522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.731715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.732033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.732447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.732791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.733103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.734847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.745150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 327/654] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.746110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.751737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 328/655] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.752184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.845391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.875075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb762b4-011f-4f12-aac0-1b1d1b6c2982 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.875316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806bc4a-0c53-4a87-b981-925482256ac3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:11.913623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.914185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.914464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.914738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.919266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:11.920154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:11.920584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:11.921020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:11.921816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:11.922267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.922560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:11.923976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.924096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:11.934433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:11.935600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:11.936746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:11.937643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 328/656] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:11.938167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:11.950097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 329/657] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:11.951285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.052871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae1c10-2504-4207-844f-a09e7fd8cd03 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.077137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba874b3-6ff4-4a28-9eba-dc759fa0228a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.093918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.094567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.094843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.095114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.098051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.105888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.107835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.116057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.116668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.116949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.117223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.117955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=b95d02dc83464209b536460b970d024b) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:12.118265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:12.119394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:12.120455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:12.121982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:12.122547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.122629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 329/658] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:12.122629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.136748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 330/659] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:11 2022] GET /identity/v3/role_assignments?user.id=b95d02dc83464209b536460b970d024b&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:12.136748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.239555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.265037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9662b5-33d5-4e4a-8bf8-aa6c03e568f0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.298261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10948ba-fed2-46d6-9552-7286cdb2b7cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.338279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.338569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.339003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.339488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.341304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:12.341878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.344631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.349507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.350426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.350778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.351057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.361224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.362690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.370566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 330/660] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:12.371715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:12.382640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:12.383648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 331/661] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:12.385958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.451038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.517095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc00868-37aa-4f9a-bc8a-fa28a91fde73 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.520790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aeeae-6435-43c2-b519-360cf160e92a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.555003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.560194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.560899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.561244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.561524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.562275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:12.562583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.564078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.578291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.579167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.579601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.580053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/528934c45fb140dea3dc59f2056fcd5a/roles/1a36073c19844c26b5262f438257d932` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.588858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 331/662] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:12.590023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.599371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=528934c45fb140dea3dc59f2056fcd5a, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.601337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.623790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 332/663] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:12 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/528934c45fb140dea3dc59f2056fcd5a/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:12.623790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.754137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44b721-722e-450f-b0ff-02c107d8f4c7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.775320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.807482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.808250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.811139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.811139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.811139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:12.811139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:12.811407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:12.826784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037fd355-3078-44cf-9d85-a64f0379b653 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.832746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 332/664] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:12.839539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:12.875042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.875784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.876472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.876858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.939790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:12.954980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5dd7a-1630-4b29-b422-2bfebf4cc52d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:12.992027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:12.995528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:12.995528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:12.995528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:12.997598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.000298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.040148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.070586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.072418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.179615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 333/665] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:13.185624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.207325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 333/666] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:13.212823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.324899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.352341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.361841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b94be-df5a-40b1-80f6-95dea6b84342 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.383534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b600c7-158f-4e36-8ecb-91b3ba3d1d5d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.400305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.401034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.401318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.401593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.412366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.414222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:13.444443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:13.445675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:13.446894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:13.446894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:13.446894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:13.456561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 334/667] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:13.457667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.474216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.475108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.475567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.476013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.495281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.497086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:13.526220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:13.527442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:13.528470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:13.528470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:13.528470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:13.529404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 334/668] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:13.536702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.610846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a68a6c-d47d-471d-9d1b-17e83a05a0f6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.638066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.647106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.647443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.647725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.648093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.648664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:13.648968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.651315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.663056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99704438-18be-48f5-be23-f10a44b3dcc5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.664603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 335/669] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:13.675152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.694245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.719850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.720471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.720756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.721031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.721686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:13.727057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.729397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d2c9d9-db30-4d37-8886-1923df8990e2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.746138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 335/670] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:13.748318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0df65-f6e0-428c-988f-85d6a53f3e62 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.748832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0df65-f6e0-428c-988f-85d6a53f3e62 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.749299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd0df65-f6e0-428c-988f-85d6a53f3e62 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.751027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 336/671] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:13.753250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0df65-f6e0-428c-988f-85d6a53f3e62 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:13.805898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca400a-8c1c-48ca-a427-1d24c0f8cd79 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.844775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.845468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.845858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.846197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.854202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.855959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7d85aa13-3757-4222-b96f-85ac261de5a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:13.869450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:13.870775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:13.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:13.875526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 336/672] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:13.877442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.877787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.878149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.893091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd0df65-f6e0-428c-988f-85d6a53f3e62 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:13.904890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:13.906333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:13.938377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:13.939918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:13.940389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:13.941101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:13.954019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:13.956382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:13.971566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:13.976610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:13.977565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:13.979152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:13.986651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 337/673] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:13.988004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.003635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 337/674] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:14.006860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.054083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:14.170813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3f55-ea62-4df8-9eac-57826e06e9f5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.208938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.209912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946c80a-18f5-454e-b0dd-4d5e38334cc3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.210194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.210677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.211167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.212263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:14.213347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:14.215088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:14.229179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 338/675] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:14.234873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.291613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.292268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.292556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.292833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.293533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:14.293860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:14.295277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:14.320519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 338/676] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:14.326999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.364155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326e44b-938d-4e17-ac6d-02ec0b162c91 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.368046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:14.386961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:14.416990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.417961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.418317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.418657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.419478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=bea41ec6a516482e89cbcd12344250e4) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:14.420139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:14.422468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:14.435862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 339/677] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/role_assignments?user.id=bea41ec6a516482e89cbcd12344250e4&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:14.437183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.520632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c73798-6a1d-46f7-91b2-d317429fb90b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.583418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.584082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.584366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.584645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.585405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=e8335dd9c12b44f885d60cff8f59e55a) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:14.585719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:14.587356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678d49-74f2-4b99-82ba-fcac712de86d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:14.595937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 339/678] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/role_assignments?user.id=e8335dd9c12b44f885d60cff8f59e55a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:14.597672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7b5b-6d82-4dcb-b6cd-fd740752182c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.598205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7b5b-6d82-4dcb-b6cd-fd740752182c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.598699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa7b5b-6d82-4dcb-b6cd-fd740752182c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.603143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 340/679] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:14.611608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.612646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.614083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.640586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:14.642175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:14.648762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98bd482-2148-4404-a786-eadcde6ad238 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.701752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.702340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.702621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.702905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.722530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:14.728667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 341/680] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:14.728873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:14.729787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:14.730642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:14.736417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 340/681] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:14.737447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.774246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:14.854119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81818-27bf-4a7a-b75f-ce0173cddf64 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:14.894377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:14.894996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:14.895283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:14.895559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:14.896271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:14.896576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:14.897942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:14.910872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 342/682] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:14.916967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:14.956194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.043289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73ad40-63d6-4f3d-a0f3-3157679cfb40 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.065112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.111250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.111937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.112219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.112498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.124167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.125651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-87efa776-aa32-40ea-956d-033e93d2a714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:15.145372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:15.146366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:15.147343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:15.147343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:15.147343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:15.147343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 341/683] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:15.148764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974498-250f-4117-a760-e436943bd558 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.148764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974498-250f-4117-a760-e436943bd558 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.148764 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29974498-250f-4117-a760-e436943bd558 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.150839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 342/684] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:15.154856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974498-250f-4117-a760-e436943bd558 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.206958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818e0d-5ba2-40db-8c21-a63ca1b0195c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.217569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.245646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.246416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.246767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.247110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.256620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.262534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.264321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.279838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29974498-250f-4117-a760-e436943bd558 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-618364e8-0ac2-4d99-9f61-8d8ce9343405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:15.280759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:15.281869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:15.282946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:15.282946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:15.282946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:15.284817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 343/685] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:15.286363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.286860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.287332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.307798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:15.309445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:15.318177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.318675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.319009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.319292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.320070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:15.320381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.323469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.342468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 343/686] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:15.342468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.404261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 344/687] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:15.405618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.476871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1eb7a-67f4-42b3-89b0-eca1fbc6fbd6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.554493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.555129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.555408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.555748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.557134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:15.557443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.558710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.560190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.592115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.594262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 344/688] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:15.596900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.620974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45689f30-6c36-43eb-98aa-d0e7dd98e0ce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.698319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.698955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.699239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.699517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.706939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.708417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:15.722093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:15.723106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:15.724714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 345/689] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:15.729158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.742888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915238a-5e1b-4755-89d3-220eaf6093c6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.785194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.785925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.786215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.786495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.787151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.788885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.816567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 345/690] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:08:15 2022] POST /identity/v3/users => generated 254 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:15.817795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:15.897894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b8b7-c36a-4e74-a54e-eda9f831e2d0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.902993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.950791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:15.951529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:15.951851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:15.952288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:15.953074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:15.953382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:15.954873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:15.966469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:15.980757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e9f2cf-d10a-461a-baa6-d2994a1096af None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:15.997705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 346/691] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:16.003236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.024415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.025118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.025553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.025882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.037367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:16.043776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:16.044770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:16.045843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 346/692] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:16.053544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.152734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244a056-0ac3-469d-8bbb-fdd32958d9ba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:16.198795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.199256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f9fd44-b945-4958-b649-3910f19ac6a7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:16.199442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.199691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.200052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.219903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:16.244906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.246051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.246348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.246916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.247616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:16.247954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:16.249577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:16.266939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 347/693] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:16.272259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.301754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:16.303383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:16.308125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:16.458720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 347/694] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 23 23:08:16.468815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.513313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb6128-8f4c-463e-ac5a-ec8ef8d0e149 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:16.588481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.589143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.589424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.589699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.606712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:16.608283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:16.640318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:16.641352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:16.642879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:16.642879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:16.642879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:16.642879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 348/695] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:16.648695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.658285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:16.671547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be290036-bf40-4fbf-a471-5bf75864e108 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:16.721821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.722470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.722749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.723020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.744519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:16.758162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:16.759716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:16.809303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:16.810621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:16.812198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:16.812198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:16.812198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:16.812198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 348/696] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:16.816625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.850859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa1dab7-e9bb-44c7-b198-781dba108112 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:16.902153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:16.902781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.903205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.903478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.904854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:16.905167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:16.906565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70362d66-e9bf-40f1-b833-7eae6e510c5b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:16.929583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 349/697] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:16.932413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867258-687b-404c-98a6-9028ef3a6816 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:16.932774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867258-687b-404c-98a6-9028ef3a6816 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:16.933232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a867258-687b-404c-98a6-9028ef3a6816 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:16.940566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 350/698] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:16.942478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867258-687b-404c-98a6-9028ef3a6816 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:16.997680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae1eb3-dcfc-46a2-a13e-b671ba72c5b1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.043530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.044946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.045465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.045970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.047344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:17.048015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.050288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecc30c-dd47-4106-98c9-a974838e6324 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.065403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 349/699] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:17.067139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.067654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.068160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.080881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.097027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:17.098609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:17.118565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.142773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a867258-687b-404c-98a6-9028ef3a6816 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.188386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 350/700] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:17.190329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.207800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.207800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.207800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.207800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.232619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.234247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-469e0ad2-032a-487a-8a11-9b1d8977db32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:17.254119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:17.255134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:17.256134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:17.261141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 351/701] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:17.262665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2fb00-fb50-47e5-94d2-8f1e7d63f510 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.262997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2fb00-fb50-47e5-94d2-8f1e7d63f510 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.263280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2fb00-fb50-47e5-94d2-8f1e7d63f510 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.264657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 352/702] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:17.265378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2fb00-fb50-47e5-94d2-8f1e7d63f510 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.323458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13b013-8da3-47fd-927b-e80a492afabf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.371634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.372523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.372830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.373073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.376056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.382027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.384816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7f6146ee-dbf0-43ee-b115-4ce529c304b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:17.401047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:17.402270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 351/703] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.408195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.408947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.427775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:17.429651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:17.432194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2fb00-fb50-47e5-94d2-8f1e7d63f510 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.476041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.477005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.477441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.477932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.479073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:17.479585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.481216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.508795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 353/704] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:17.510589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.516929 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 352/705] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:17.517843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.523834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.643430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d4c75-4c5e-4581-839f-5853e329d670 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.682080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.682831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babdc71-0375-486a-8689-1c1b7d068b2f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.702267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.703240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.703702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.704282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.727856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.728886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.729380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.729939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.731327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:17.731979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.733739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.751055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 354/706] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:17.752312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.806808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.809586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.836681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:17.879128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e9fc-03d8-4f2d-b363-e83644b07e0d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:17.924706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:17.925352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:17.925634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:17.925908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:17.926502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:17.927909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:17.937185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 353/707] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:17.937185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:17.940867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:17.941921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:17.946801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 355/708] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:17.947734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:17.969453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.054442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31553ea-5e29-4bd7-9329-b6b3e1a07518 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.069299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d05b22-4b70-402e-a5d6-fa98f9fd6845 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.094890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.095418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.095696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.095992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.096723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.097029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.098704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.104552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.106500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 354/709] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.107410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.120531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.121464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.121934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.122362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.123142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.124961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:18.138161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:18.139482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:18.140568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:18.143367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 356/710] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:17 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:18.144555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.238734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.255393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5eaa1-8797-4223-873e-f9ea198556e1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.285668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f64e7-932a-45fc-8b4e-46b6d4cd7ae3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.304021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.304827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.305223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.305594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.317746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.319342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.324845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.325466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.325752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.326027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.326668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.326982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.328412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.333842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 357/711] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dde76927-f607-46e1-8aed-aa690139eddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:18.336133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:18.337941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:18.339215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:18.339215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:18.339215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:18.339215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 355/712] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:18.339505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.340532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8521a2-30d9-439c-84c8-a6dff16d1344 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.340886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8521a2-30d9-439c-84c8-a6dff16d1344 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.341230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8521a2-30d9-439c-84c8-a6dff16d1344 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.342707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 356/713] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:18.348726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.348726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.348726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.367321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:18.369801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:18.421966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.455792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 357/714] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:18.456900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.484808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46643511-2cf7-4b95-b73d-d1e17ef45cf6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.543776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.544606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.544993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.545635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.546394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] RBAC: Adding query filter params (name=network) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.547461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.549370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.550565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.558494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 358/715] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.560504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.598415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a464d2d-e5a9-4c02-ba6b-d4679013c291 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.635417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.636367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.636885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.637325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.638173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.638631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.640462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.658576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 358/716] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.659499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.684779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6233a-a46a-4c01-b81f-03fb5573b947 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.712136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.721200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.722111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.722582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.724115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.724115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.724115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.731778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.744548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 359/717] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.746144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.785166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8dc4d-4e78-473d-9111-3102939f7dcc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.825349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:18.833556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.834204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.834487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.834766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.835435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:18.835746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.837712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.851913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 359/718] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/services?type=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:18.853697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:18.906210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d2722f-244a-43a9-a432-9c6639671c46 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:18.949730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:18.950604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:18.950960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:18.951309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:18.960557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:18.962648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:18.981380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:18.982382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:18.983290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:18.985860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 360/719] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:18.993079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.022340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b0337-d96c-4d6a-9193-01694005df7b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.063235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.065407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:19.066501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.067093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.067601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.084824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:19.093874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:19.094874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:19.095781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:19.098654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 360/720] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:19.109047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.130231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb8394-52da-4da9-85e6-8b39d2b4e09a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.169836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.170733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.170862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.171080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.171873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:19.172254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:19.173728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:19.174720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:19.192969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 361/721] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:19.196861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.225677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6f6c7-5582-426a-9eb1-25f55f51f295 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.276678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.277664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.278156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.278663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.279613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:19.280172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:19.281787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:19.292010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 361/722] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:19.301679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.334848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23c471-3c11-49f1-adb2-f674d41867d2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.353710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:19.392440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.393455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.394093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.394664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.395610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=528934c45fb140dea3dc59f2056fcd5a) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:19.396162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:19.398223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:19.408875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 362/723] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:19 2022] GET /identity/v3/role_assignments?user.id=528934c45fb140dea3dc59f2056fcd5a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:19.522694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0bace7-7c9a-434c-bf5d-231f05942081 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.544615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:19.576140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.576805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.577093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.577370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.594157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:19.595710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:19.615021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:19.616087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:19.617123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:19.617123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:19.617123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:19.617123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 362/724] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:19.625982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.749044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874cdf6-99d1-4776-8159-135deabd2ede None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.788031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.788577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.788858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.789130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:19.789784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:19.790156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:19.792629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:19.806784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 363/725] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:19.816398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:19.949822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4ebb1-0661-424e-b8ac-fde76d0ca54c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:19.992635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:19.993320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:19.993600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:19.993870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:20.005693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:20.007211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:20.020742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:20.021753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:20.022703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 363/726] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:20.031979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:20.119141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:20.461350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b7bf-f940-4c81-8f87-ac1a766b6c2c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:20.547474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:20.548557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:20.549056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:20.549530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:20.550904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:20.551460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:20.554265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d443198c-a2c0-4366-940c-964f6a9502d1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:20.594059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 364/727] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 563 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:20.602683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:20.652204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:20.726825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799f58-3797-4f76-9d13-807e0f0128fa None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:20.727468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799f58-3797-4f76-9d13-807e0f0128fa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:20.728383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81799f58-3797-4f76-9d13-807e0f0128fa None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:20.736279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 365/728] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:20.742290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436caff5-6d4e-4c98-8b5f-7fa9e48c5738 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:20.742522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:20.742892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:20.743418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:20.780058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:20.780745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:20.781030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:20.782283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:20.821984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:20.824048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:20.856393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:20.858308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:20.896233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:20.975048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 364/729] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 23 23:08:20.983240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:20.993401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 366/730] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:21.089557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e0828c-f302-4ee5-8da7-7f741897abcb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.120483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.125777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.127023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.127447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.127730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.139939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:21.141399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:21.157411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:21.158416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:21.159346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:21.159346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:21.159346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:21.159346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 365/731] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:21.167023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.204165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.310972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50827b1-6623-4245-890e-06ab9ae76996 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.346925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.347549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.347858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.348140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.348802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:21.349108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:21.350490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301009c-29c6-4fdc-afdd-a2c93ca3c570 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:21.363435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 367/732] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:21.368508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.399081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda65fe-3367-4591-85a0-c24d14c5b6cd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.399976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda65fe-3367-4591-85a0-c24d14c5b6cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.400221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda65fe-3367-4591-85a0-c24d14c5b6cd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.402085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 368/733] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:21.407418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.407699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.408019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.427707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:21.429582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:21.523886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aca31-f648-4ba2-b858-c3d58bd527c8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.528629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 369/734] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 23 23:08:21.529309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.544998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.589795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.590992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.591506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.592058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.601869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:21.604450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4fe91acd-da6e-41d2-b99e-24bed138551c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:21.622025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:21.622970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:21.623915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:21.629628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 366/735] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:21.629628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792f72-26e3-4842-bea0-e4fd1a9825ec None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.629628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792f72-26e3-4842-bea0-e4fd1a9825ec None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.629628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc792f72-26e3-4842-bea0-e4fd1a9825ec None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.629628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 367/736] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:21.633756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc792f72-26e3-4842-bea0-e4fd1a9825ec None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.675226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80999b6-5fad-46b6-b3a6-ab6314df1115 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.699505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.721823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.723435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.723931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.724427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.739739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-63ddea78-416c-477a-a0a3-0977bd13aafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:21.747001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:21.748029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:21.748893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:21.749563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 370/737] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:21.751020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.751571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.751870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.770620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:21.771904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:21.780484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc792f72-26e3-4842-bea0-e4fd1a9825ec None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.826370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.826940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.827231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.827513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.828260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:21.828586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:21.830108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:21.847989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 368/738] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:21.847989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.851785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.868119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 371/739] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 23 23:08:21.871406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:21.955950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:21.958926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a620a52b-5961-44af-bdd0-75be7aad11bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:21.997380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:21.997996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:21.998279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:21.998557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:21.999245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:21.999526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.000957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.011325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 369/740] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:22.013329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817b108-bfea-4587-89dd-12f7db16b59d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.016727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.061720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.063178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.063670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.064595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.065909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.068345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.096971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 372/741] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:21 2022] POST /identity/v3/services => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:22.098335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.130464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b2f25-6d07-4a8a-92ce-e76c1b06e850 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.178424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.179054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.180018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.181312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.182868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=3eb0da545f0548649d8f9c191dd03fc5) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:22.183724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.186181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.195289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 370/742] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:22 2022] GET /identity/v3/role_assignments?user.id=3eb0da545f0548649d8f9c191dd03fc5&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:22.196187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:22.197678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.258142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:22.300294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682483c-b367-48b9-893c-d5506d6737bf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.354209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.355586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.356123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.356749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.363899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e098a-2c22-405e-a7c8-36efeea37544 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.372969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.375359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:22.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:22.395595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:22.396571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:22.396571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:22.396571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:22.397676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 373/743] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:22.403365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.419716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.420459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.421385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.421385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.421664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.423085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f454ea-316e-4037-8754-44b628eccabb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.445410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 371/744] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:22 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:22.562939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4028d-8720-403a-9287-83d73acbeddf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.581115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:22.606621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579172-6bb1-4627-9590-8a9c3a1359ab None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.607121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579172-6bb1-4627-9590-8a9c3a1359ab None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.607121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579172-6bb1-4627-9590-8a9c3a1359ab None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.608696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 372/745] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:22.614563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.614895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.615129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.633794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.634426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.634949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.635207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.635901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:22.636209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.637595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.641640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:22.643168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:22.661585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 374/746] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:22.663150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.731289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 373/747] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:22.793241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db7ad6-f38a-4ed8-9146-1b129f9b5090 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:22.829419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:22.830064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:22.830344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:22.830615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:22.839250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:22.840730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:22.853538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:22.854857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:22.855954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 375/748] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:08:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:22.861704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:22.888585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:23.002292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d01e53-7b19-42fa-92c0-4490401ce772 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.041145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.042145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.042635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.043134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.044178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:23.044693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:23.046348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:23.058358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.066770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 374/749] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:08:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:23.072727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.103979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:23.225311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:23.231580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb86c55-f4dd-433f-aca1-e76863b99a04 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.268725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.269654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.270081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.270599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.286862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:23.300361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:23.302329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:23.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:23.313432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 376/750] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:23.320389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.322981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90e4e8-f8e0-45e8-b9c7-429a12b60170 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.413891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.414828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.415828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.416287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.439814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:23.441583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:23.478310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:23.479509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:23.480656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:23.480656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:23.480656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:23.489650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 375/751] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:23.495081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.536148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:23.609770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd771b-687d-46d8-a95a-06d277adf7fa None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.613287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448402f4-6325-4859-964e-94648aeceb92 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.640436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:23.659391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.660040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.660326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.660604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.661260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:23.661567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:23.663736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:23.679080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.679705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.680012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.680288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.680995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:23.681303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:23.682681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:23.690048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 376/752] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:23.696498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.710726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 377/753] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:23.711676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.806711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae5823-0461-4503-a187-5a6429cf2501 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.843177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:23.843856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:23.844144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:23.844421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:23.851483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:23.853536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:23.865359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:23.866307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:23.867230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 377/754] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:23.878905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:23.941564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f685f1-34a0-494b-b673-623467ae0670 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:23.961671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:24.009771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.010536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.010818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.011092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.031560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.033626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.051061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc741e8-32a3-442a-a939-838a368de0f1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:24.066757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:24.067749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:24.068727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:24.068727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:24.068727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:24.068727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 378/755] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:24.074364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:24.081524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:24.109778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.110806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.111323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.111832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.112746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:24.113285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.114970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.138335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 378/756] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:24.144236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:24.223978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1e5de6-13ba-4889-bd6b-866264525310 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:24.264969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.265944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.266435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.267049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.268527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:24.269400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.271269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.285755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 379/757] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:24.294856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:24.398232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bf6409-675a-4c56-8a39-46fa108ed9cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:24.401802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:24.414312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:24.464358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23992851-9db5-47b8-b769-c4a082d6981f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:24.509641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.510771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.511281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.511801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.520456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.522511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:24.536656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:24.537741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:24.538716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:24.541454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 380/758] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:24.548100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:24.549404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.550105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.550380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.550651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.556320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=6aee1815f27f44e5a738eda3234595e6, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.558863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5bc20-ca25-4cc8-8a1f-6b47e536f436 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.582566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 379/759] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:24 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:24.585366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48402a-fd1e-412a-9685-65abc06a38e8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.585366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48402a-fd1e-412a-9685-65abc06a38e8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.585638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48402a-fd1e-412a-9685-65abc06a38e8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.591800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 380/760] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:24.603013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.603362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.603565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.640495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:24.642070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:24.763661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73cbe31-7af5-464e-a995-bf6e89515213 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:24.783240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 381/761] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:24.791442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:24.805205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:24.805951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.806320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.806665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.807483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:24.807839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:24.809292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923d062e-6ca5-4fc0-bbd8-7ed6a3f5a453 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:24.830981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 381/762] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:24.836659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:24.849628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876017a6-cfae-46cc-be5e-2a0d3f4eead1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.849933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876017a6-cfae-46cc-be5e-2a0d3f4eead1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.850305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876017a6-cfae-46cc-be5e-2a0d3f4eead1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.851662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 382/763] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:24.857108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd02d9-b851-4e70-871b-0aa52eadb493 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:24.857418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd02d9-b851-4e70-871b-0aa52eadb493 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:24.857778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd02d9-b851-4e70-871b-0aa52eadb493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:24.888799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b4fd02d9-b851-4e70-871b-0aa52eadb493 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:24.890051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4fd02d9-b851-4e70-871b-0aa52eadb493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:25.014394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.020500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 383/764] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:25.027988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0d4-e08e-4814-94b3-668ee4f6a3f7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.027988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0d4-e08e-4814-94b3-668ee4f6a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.027988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4b0d4-e08e-4814-94b3-668ee4f6a3f7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.027988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 384/765] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:25.032063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e547cc8-1470-472b-a847-68776ea15119 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.033660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.033945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.034220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.072993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:25.074217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:25.083897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.084890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.085383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.085876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.150522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 385/766] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:25.152298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.190682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.195780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.236503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.356611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.367106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2898b6-15d4-48ad-8c74-1f86c95d8993 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.370331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 382/767] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:08:25.380871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.414253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.414890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.415681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.416292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.416895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.418277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:25.427562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:25.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.429509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 386/768] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/services/network => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:25.430325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.490131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795fe70-5c7b-4ff5-8eaa-0aed3cd4e1e4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.534487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.535245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.535533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.535840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.553622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:25.558607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f112bb5a-7006-4f03-93a1-32bed60290c3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:25.559049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:25.560182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 383/769] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:25.561046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.566983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.602989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.603730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.604105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.604393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.615929 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.617329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.622418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:25.634287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:25.635310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:25.636252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:25.636252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:25.636252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.636252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 387/770] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:25.636252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.681952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bf22a-f8b6-49ec-9ab2-992fc2838390 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.721494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.722116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.722400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.722678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.723319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] RBAC: Adding query filter params (name=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:25.723626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.725064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.736822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 384/771] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:25.738050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.752454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a24d70-a62d-4cb5-91e6-42fba2704ebb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.787663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.788390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.788675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.788972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.789568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.791815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:25.801533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:25.802747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:25.803804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:25.807857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 388/772] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:25.808781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.833032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.862820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06532e7f-1b70-4491-91b0-5879397b94db None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.884643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:25.905590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.906130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.906418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.906697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.907370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:25.907678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.909083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.918253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 385/773] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:25.920763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:25.925005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff48cd8-ebee-45b9-bd48-9bf24c6cfc10 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:25.974800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:25.975444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:25.975721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:25.976030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:25.976869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:25.977196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:25.979237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:25.992797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 389/774] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:25.993763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.040352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0898b15-ae49-45b5-885e-25d4a751fef9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.075714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.076361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.076641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.076923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.077567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.077877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.079263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.084953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 386/775] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.085787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.091139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.109313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9943-783e-431f-aed1-ef0a7292b79c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.136082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.149436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.150565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.150938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.151216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.151889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.152192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.153637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.163439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 390/776] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.164219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.196013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed8108-8987-46ab-8a4e-3ff6f5cd90a8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.231344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.232023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.232309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.232588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.243576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.245237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:26.262971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:26.264116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:26.265217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:26.265217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:26.265217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:26.265217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 387/777] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:26.265771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.275138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21ef94-c039-43aa-bb25-b0c49dfb7db2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.310593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.311238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.311517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.311815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.318958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.320452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:26.332892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:26.334024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:26.334927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 391/778] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:26.335423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.343612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.382707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.392384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11602233-4abc-4ac8-8960-62c3cd535195 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.430386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.431963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.432399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.432926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.434191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] RBAC: Adding query filter params (interface=public, service_id=fd74622fcb2e421ba586466ca3a82038, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.434776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.437137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.445159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 388/779] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/endpoints?service_id=fd74622fcb2e421ba586466ca3a82038&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.446070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.460763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacb0a0-c312-47c7-990c-536d55db403f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.497502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.498216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.498501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.498771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.499410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.499713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.501104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.511748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 392/780] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.511748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.565555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d534e-3432-47d1-9afa-ed6e82bd0b8a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.590851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.605734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.606570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.607046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.607321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.608020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.608371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.609765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.623040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 389/781] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.624278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.636044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf46f34-7e82-4e7b-b01b-db26d28440c2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.645267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.673156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.673796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.674051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.674325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.675025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.675344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.676829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.693400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 393/782] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.694389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.732776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2202f-c80a-4a1c-a23e-cb6797ac5280 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.768411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.769026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.769309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.769582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.770190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.771562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.784420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 390/783] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/services => generated 772 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.784420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.809170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a75552-a641-434b-85c7-8c872b8cb8cc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.841427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.851062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.851701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.852125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.853153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.854516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] RBAC: Adding query filter params (interface=public, service_id=3c1a76d8befa479889fda6a0488ec93f, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:26.854829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.856223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4d03b-d74a-4f45-9e95-5d35aced3abd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.865381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 394/784] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/endpoints?service_id=3c1a76d8befa479889fda6a0488ec93f&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:26.866501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12bc03-f92d-4926-849d-b9988b00542b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.866785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12bc03-f92d-4926-849d-b9988b00542b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.867056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12bc03-f92d-4926-849d-b9988b00542b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.871906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 395/785] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:26.871906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12bc03-f92d-4926-849d-b9988b00542b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.882517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:26.911167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc4388-8b40-4001-bb5a-07450facfee7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:26.955015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313c705-ec82-450b-a479-935da534643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:26.955783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c705-ec82-450b-a479-935da534643b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:26.956063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c705-ec82-450b-a479-935da534643b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:26.956335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313c705-ec82-450b-a479-935da534643b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:26.965117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313c705-ec82-450b-a479-935da534643b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:26.966668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313c705-ec82-450b-a479-935da534643b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b313c705-ec82-450b-a479-935da534643b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:26.979968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:26.980997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 391/786] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:26.982846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313c705-ec82-450b-a479-935da534643b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:26.998115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12bc03-f92d-4926-849d-b9988b00542b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.038899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.039623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.039845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.040600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.041745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=528934c45fb140dea3dc59f2056fcd5a) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:27.042058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:27.043685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6162955a-d01f-40ca-981e-cfa1dac8f1db None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:27.058231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 396/787] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/role_assignments?user.id=528934c45fb140dea3dc59f2056fcd5a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:27.058231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.058231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.058231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.073466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:27.074705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:27.105548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313c705-ec82-450b-a479-935da534643b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.146370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.147090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.147498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.147883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.148583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:27.150771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:27.156157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:27.160648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 392/788] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:26 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:27.162319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.173406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:27.195501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 397/789] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:27.290645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7cff4-690a-4516-aef1-12803d4080bf None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.333119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.334080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.334529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.334803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.335545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:27.335894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:27.338345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:27.359895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 393/790] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:27.365047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.493120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca90b5e8-6ba1-48f3-9db6-6091520d9101 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.544859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.545649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.545938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.546216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.567130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:27.568646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:27.572574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:27.588543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:27.589562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:27.590796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:27.590796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:27.590796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:27.590796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 398/791] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:27.595136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.651024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:27.706321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:27.725762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbc13d-4c85-44f3-aca4-b9fb03f2d53a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.772212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.772750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.773495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.773495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.774099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:27.774970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:27.776744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:27.789354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 399/792] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:27.795268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.809814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f967-8305-4b78-8540-cbf793b1a8aa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.900331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:27.902003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:27.902519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:27.903000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:27.916424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:27.921976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:27.922918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:27.923805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:27.926264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 394/793] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:27.935080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:27.940759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b3c46c-940b-497b-8ead-1e55a55d6cea None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:27.943982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:28.027666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.028317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.028598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.028874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.044761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.047165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:28.065571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:28.066515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:28.067425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:28.069865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 400/794] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:28.084701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:28.110614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b98d92-7d85-4a6e-8215-872328773d27 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.137319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:28.148878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.150724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.151255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.152441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.153326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:28.154010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.156723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.173998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 395/795] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:28.181622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:28.287685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316e82-23fc-4347-91e7-d80826bf25fc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.353804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.354890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.355379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.355889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.356828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:28.357355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.359011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.372035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8813270-17a1-487f-944a-24ff5de46dc3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.386030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 401/796] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:28.395736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:28.432308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:28.441851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.442505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.442794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.443075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.466269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.469163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:28.498757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:28.499809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:28.500745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:28.500745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:28.500745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:28.505327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 396/797] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:28.510108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:28.582704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79133a71-f93a-45b6-8294-53b8fa20175c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.586008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:28.654747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.655451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.655737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.656041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/3eb0da545f0548649d8f9c191dd03fc5/roles/1a36073c19844c26b5262f438257d932` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.686786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=3eb0da545f0548649d8f9c191dd03fc5, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.688287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.702172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f95762-6a69-4cd6-a903-6da34bd2da53 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.723550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 402/798] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:28 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/3eb0da545f0548649d8f9c191dd03fc5/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:08:28.771457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.772120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.772405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.772666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.773346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:28.773651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.775681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf0a6f-3e9f-4789-915a-f64d4d068911 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:28.799395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 397/799] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:28.806740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:28.897618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:28.916568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c05-705e-4b62-86f1-2e6cd38f8e06 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.917393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c05-705e-4b62-86f1-2e6cd38f8e06 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.917393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f0c05-705e-4b62-86f1-2e6cd38f8e06 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.923998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 398/800] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:28.928424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.928714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.928979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.939040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365bdb4-7efa-4482-8791-cba27cd7d1d4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:28.973805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:28.975044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:28.981766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:28.982812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:28.983345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:28.983873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:28.995025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:28.997999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:29.012362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:29.013391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:08:29.014345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:29.017100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 403/801] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:08:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:29.022427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:29.071427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 399/802] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:29.144726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dd65e-0b0e-4597-a492-7293a09fbfee None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:29.173659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:29.184039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:29.185014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.185501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.185969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.186900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:29.187405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:29.189196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25fd0ac-3ecd-4420-a767-846ff89d6e44 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:29.209060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 404/803] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:08:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:29.214560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:29.267048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:29.364529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dabbc-0da1-40f7-9a46-8440dc5a74e4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:29.408975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:29.409602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.409888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.410165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.499998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:29.501703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427b947-b3ee-4de3-b38b-4309c392864e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:29.534663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:29.602025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7000d-a4eb-432a-997b-0b4fc75e7740 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.603523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7000d-a4eb-432a-997b-0b4fc75e7740 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.603523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7000d-a4eb-432a-997b-0b4fc75e7740 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.605552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 405/804] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:29.613715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7000d-a4eb-432a-997b-0b4fc75e7740 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:29.655816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 400/805] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:29 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:08:29.655816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94ad8-a284-4baa-8a20-94d238970f2d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.655816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94ad8-a284-4baa-8a20-94d238970f2d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.655816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb94ad8-a284-4baa-8a20-94d238970f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.672625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0bb94ad8-a284-4baa-8a20-94d238970f2d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:29.673838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0bb94ad8-a284-4baa-8a20-94d238970f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:29.742432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7000d-a4eb-432a-997b-0b4fc75e7740 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:29.753588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 401/806] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:29.755202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3417-ceea-4666-9957-ffb091cae67f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.755484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3417-ceea-4666-9957-ffb091cae67f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.755779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df3417-ceea-4666-9957-ffb091cae67f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.757179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 402/807] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:29.762492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3417-ceea-4666-9957-ffb091cae67f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:29.785521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:29.786458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.786894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.787322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] PATH_INFO: `/v3/services/network` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.788225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:29.789628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-da05f6b6-861f-4afc-8a5b-f98d5dd6fa13 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:29.801642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:29.802707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:29.804092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 406/808] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:29 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:29.804964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.804964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.804964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:29.825278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:29.826624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:29.842668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:29.892246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:29.925041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df3417-ceea-4666-9957-ffb091cae67f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:29.941390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 407/809] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:29.944251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:29.995414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:29.995414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:29.995414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:29.995414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.025314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.027123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:30.061382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:30.063208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:30.065022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:30.065022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:30.065022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:30.066817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 403/810] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:30.072823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.147341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63036e2-39d1-4a92-8be5-55cc17fb856b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.191654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.192303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.192589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.192867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.193565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:30.193877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.195716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.207455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 408/811] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:30.208368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.264798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.330758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5c74-00d8-4d4e-b479-adcab05596c8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.367062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.367713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.368597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.369044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.369475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.370998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:30.380600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:30.381665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 23 23:08:30.382532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:30.387446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 409/812] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:30.388158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.441091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c22e0-cace-40c9-9c67-81d9b3038c81 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.454155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.480762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.481370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.481648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.482329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.482987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:30.483285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.485047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.497299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 404/813] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:30.497918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.514816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11635ba3-6a6d-4066-89c1-e94dc95aa0cc None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.525340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.553879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.554494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.554779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.555054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.556311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:30.556626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.558040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.563157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 410/814] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:30.564169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.622145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47238b-42c0-42ef-a4e1-8134e5273c62 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.666978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.668095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.668715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.669069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.674409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58750b2-b142-4905-846f-a7a05a7fa5d4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.680316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:30.686017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:30.686965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:30.687847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 405/815] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:30.688542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.717074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.717691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.717967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.718241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.718883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:30.719185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.720606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.721389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.725768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 411/816] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:30.726352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.771177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.807431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c359879-157c-4d46-ba87-27b6d98071a4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.842683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.843317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.843605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.843952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.847650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afb727-49f4-459b-9b62-baf428e1e1af None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:30.850672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.852142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:30.864867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:30.865990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 406/817] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:30.867085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.893744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:30.894341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:30.894637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:30.894953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:30.895557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:30.896967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:30.931796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 412/818] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:30 2022] POST /identity/v3/endpoints => generated 337 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:30.931796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:30.985275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:30.999199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8428c-dbad-410c-9395-9bd43a848c52 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.047940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.048692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.049050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.049418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.050265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:31.050659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.052324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.068158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 407/819] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:31.068386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.068474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.091047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ef18f-c5b2-4581-9928-63d15ec78ad8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.142447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.144717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.145298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.145578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.146230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:31.146540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.148705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.153950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 413/820] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 23 23:08:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:31.155171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.197595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e188e8d6-c904-442c-9734-75eaef309dbc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.235874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.236487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.236766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.237035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.237727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:31.238032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.239457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.252247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 408/821] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:31.253056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.271633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.272932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e68d6-4860-452d-b767-63704d06b21f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.321723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.322460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.322818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.323164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.334669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.336186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-c01c6bd2-90c5-4685-a8df-a48e2fdf5556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:31.350877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:31.351954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:31.353425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:31.353425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:31.353425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:31.356081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 414/822] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:31.357650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f46d-088b-4df6-848b-7ed31d4b7049 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.358015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f46d-088b-4df6-848b-7ed31d4b7049 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.358305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640f46d-088b-4df6-848b-7ed31d4b7049 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.360124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 415/823] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:31.360839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f46d-088b-4df6-848b-7ed31d4b7049 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.374561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.378912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73cbcc-daa4-4917-9a22-424b8dc0133e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.420180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.420720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.421004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.421280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.421946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.423320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.448795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 409/824] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:31.449643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.501640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640f46d-088b-4df6-848b-7ed31d4b7049 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.530318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.550562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.552314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.552887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.554367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.556456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:31.557809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.560352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095a6fe-49a3-460d-89ff-2d8c02345182 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.579824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 416/825] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:31.579824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.579824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.579824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.598603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:31.600252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:31.602958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf183de-08c0-4b63-8707-f554729f5dc3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.653411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.654079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.654363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.654638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.655298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:31.655602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.657649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.673510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 410/826] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:31.678900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.719627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.724100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 417/827] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:31 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:31.808375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240c8a0d-a0f4-44a7-95d1-c2fac4fa726a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:31.836315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:31.850102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:31.850743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:31.851024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:31.851291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:31.860879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:31.862334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:31.874665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:31.875693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:31.876976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 411/828] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:31.882010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:31.998109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bc5b5-daf5-4713-989b-d9ca0c373554 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.018232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.045579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.046219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.046495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.046766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.047519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:32.047863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.049318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.077106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 418/829] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:32.078596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.146093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.163531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b3d3a5-a15f-4e19-99fc-8c54c64f4324 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.202542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d3c69-d710-4b6b-ba00-d2957295816b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.212765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.213568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.213955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.214301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.226576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:32.233910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:32.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:08:32.235799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:32.236456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 412/830] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:32.241774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.254236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.255117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.255370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.255719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.268266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.269831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:32.288735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:32.289918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:32.290864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:32.290864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:32.290864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:32.294822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 419/831] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:32.296379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.297629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.356974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64a0e4-36fb-4a7b-8219-93535a67e5ff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.395569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.396602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.397092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.397598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.398491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:32.399009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.401171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.414471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 413/832] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:32.415685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507a7338-a6fa-4d1f-9871-2019a746070d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.416122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.425728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.457193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.457815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.458099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.458378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.459037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:32.459732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.460894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.479342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 420/833] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:32.480855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.523326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ada09-ebd8-486e-8f61-9c3c3de124cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.531162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.569068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.573404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.574035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.574527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.587446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.589363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:32.605557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:32.606574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:32.607515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:32.607515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:32.607515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:32.614154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e7b69-6cb6-4a88-b0ea-8aa80258dae5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.614728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 414/834] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:32.616290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.650343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.650989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.651273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.651548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.659474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.660989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:32.673597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:32.674575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:32.675492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:32.679480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 421/835] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:32.681575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.716752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.743709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcaf77-5109-4313-93ab-f06d9116fcba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.782469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.783449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.784012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.784521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.785526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:32.786085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.787725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.799171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70d6aa-813e-4f87-be57-09b24aecb701 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.808008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 415/836] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:32.809201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.828818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:32.838336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.839483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.839789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.840078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.840885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:32.841199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.842651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.861769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 422/837] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:32.862779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:32.919425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2465de2-e86b-44de-b5c5-a4ee29db89b4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.955293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:32.956317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:32.956809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:32.957298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:32.965838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:32.967542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:32.972603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c4b58-6234-48cb-a7fd-aeb99121f733 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:32.979945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:32.980932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:32.981903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:32.988938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 416/838] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:32.990023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:33.008164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:33.015005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:33.015891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.016274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.016657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/528934c45fb140dea3dc59f2056fcd5a/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.019546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=528934c45fb140dea3dc59f2056fcd5a, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:33.021817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:33.043945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 423/839] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:32 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/528934c45fb140dea3dc59f2056fcd5a/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:33.096981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:33.122240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc9399-c840-414c-9def-977401649ff6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:33.162861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:33.163481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.163771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.164081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.164880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:33.165190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:33.166834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:33.192100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 417/840] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:33.198585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:33.322411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c8bfa-da3a-4e36-983a-442bd34ab8f0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:33.361629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:33.362632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.363119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.363615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.385115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:33.438662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:33.440173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf4086-45dc-42f1-8cb1-070b096002f5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:33.545331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 424/841] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:33 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:08:33.552671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:33.679591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab78632-2623-4266-b456-ae28515c9f6d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:33.698539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e00d2-0e5b-4b31-a695-298bfda2a82b None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.698822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e00d2-0e5b-4b31-a695-298bfda2a82b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.699100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e00d2-0e5b-4b31-a695-298bfda2a82b None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.700765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 425/842] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:33.706603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.706885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.707159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.722037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:33.722959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.723390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.723841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.726196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:33.727821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:33.728007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:33.739794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:33.741677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:33.760846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:33.762066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:33.763166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:33.763166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:33.763166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:33.765049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 418/843] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:33.770890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:33.789279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:33.815938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 426/844] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:33.885610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df8c4b-3a52-4de9-96f3-ef7fad90fa60 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:33.922987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:33.923883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.924316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.924740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.925548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:33.926037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:33.927561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8d562-c3b9-4e30-b1ab-20acdd41cf40 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:33.941987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 419/845] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:33.952111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:33.990541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e438-a0a1-4aaa-93da-317ec79ae1ef None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.991003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e438-a0a1-4aaa-93da-317ec79ae1ef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.991342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6037e438-a0a1-4aaa-93da-317ec79ae1ef None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:33.993085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 420/846] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:33.999213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:33.999497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:33.999793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.019654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:34.020894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:34.063008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40ae0f-45bc-4d6f-8706-04eceae4aef4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.084837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.099698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.100381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.100664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.100938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.104019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 421/847] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:34.104860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.108088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.109548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:34.121880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:34.122809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:34.123725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:34.127983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 427/848] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:34.128872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.170522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.219808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf6ef1-2b40-4787-b098-c8d885876fe3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.235861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf55a59-a7b0-4fbb-86ef-af5a23631d98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.261850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.262494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.262803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.263084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.263657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.265062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:34.274723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:34.275922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:34.276781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.277581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 422/849] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:34.284582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.285056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.285211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.285497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.285767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.286467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:34.286773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.288243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.306379 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 428/850] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:34.314802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.335157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.410122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d61ce-e381-4a57-a5f9-7cab60278f4b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.448841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.449064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.449542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.449822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.450099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.450758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:34.451055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.452530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.453272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ba96a-e205-4900-80f3-394041adffce None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.462344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 423/851] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:34.462344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.507412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.508551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.508950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.509229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.510450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=3eb0da545f0548649d8f9c191dd03fc5) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:34.510771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.512768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.528120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 429/852] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/role_assignments?user.id=3eb0da545f0548649d8f9c191dd03fc5&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:34.528120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.598774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d636def-12a8-479d-9881-18f2b9c80c4f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.609471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.653816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.654507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.654786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.655057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.655661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.657101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:34.670115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:34.671151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:34.672079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:34.676028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 424/853] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:34.679776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.707149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67ce706-4d09-4fe0-a69c-23f31db8c15d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.749019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.749650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.749912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.750187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.750838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:34.751148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.752887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.759088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 430/854] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:34.821752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7146d739-94b4-4a93-99a9-b6419125d7cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:34.862543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:34.863457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:34.863985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:34.864405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:34.865268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:34.865719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:34.867381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264f4a8-a152-46dc-ad7c-abfc6431c43a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:34.873536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 425/855] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:34.879457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:34.912835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:34.995823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814a66c-4257-4192-9e0f-3baab78ffd68 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:35.036299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:35.036841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:35.037126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:35.037464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:35.038117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:35.038483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:35.039906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54186d8f-5f9e-4d0a-a804-460ef45d98c7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:35.050521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 431/856] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:35.264409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805168-b7eb-455a-98a5-4c46873b38cb None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:35.264919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805168-b7eb-455a-98a5-4c46873b38cb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:35.264996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805168-b7eb-455a-98a5-4c46873b38cb None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:35.266561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 426/857] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:35.272106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:35.272393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:35.272673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:35.292795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:35.293927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:35.367704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 432/858] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:35.642830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02805168-b7eb-455a-98a5-4c46873b38cb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:35.682936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:35.756760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02805168-b7eb-455a-98a5-4c46873b38cb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:35.793473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:35.794165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:35.794452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:35.794728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:35.807020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:35.812862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:35.813895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:08:35.814882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:35.815727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 427/859] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:35.823717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:35.847241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:35.954950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1279f-f875-4731-91f4-58f76ef46acd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:36.014240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:36.014891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.015109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.015381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.016098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:36.016408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:36.017803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:36.027532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 433/860] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:36.034303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:36.138525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.145585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f712b-f2c8-49d9-ba02-36f169f0a2b2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:36.182957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80384b07-3afb-4711-a135-97cad390714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:36.183740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b07-3afb-4711-a135-97cad390714e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.184079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b07-3afb-4711-a135-97cad390714e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.184447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80384b07-3afb-4711-a135-97cad390714e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.202643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384b07-3afb-4711-a135-97cad390714e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:36.205363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80384b07-3afb-4711-a135-97cad390714e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-80384b07-3afb-4711-a135-97cad390714e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:36.232772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:36.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:36.237653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:36.237653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:36.237653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:36.237653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 428/861] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:36.241110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:36.361004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.381006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c37e887-c68d-4ce5-a8fc-355133fa23ad None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:36.422390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:36.422901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.423167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.423445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.424150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:36.424455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:36.425831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:36.438905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 434/862] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:36.444469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80384b07-3afb-4711-a135-97cad390714e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:36.558052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80384b07-3afb-4711-a135-97cad390714e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:36.599988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:36.600679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.600963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.601236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] PATH_INFO: `/v3/users/swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.610088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:36.611551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-53f48ff9-4917-45e6-af35-747ef25b35ae None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:36.624200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:36.625230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:36.626906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 429/863] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:08:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:36.632948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:36.724471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dbbb-857d-4ab3-8428-e0166ba66e4e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.724670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dbbb-857d-4ab3-8428-e0166ba66e4e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.724950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9dbbb-857d-4ab3-8428-e0166ba66e4e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.727807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 430/864] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:36.734044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62986d-2375-4114-8e5c-21ed7141ab97 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.734331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62986d-2375-4114-8e5c-21ed7141ab97 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.734597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62986d-2375-4114-8e5c-21ed7141ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.752151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.754858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd62986d-2375-4114-8e5c-21ed7141ab97 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:36.756650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b18d3f1-5ff8-4d22-ab53-56a1d58799cb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:36.756929 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd62986d-2375-4114-8e5c-21ed7141ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:36.809427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:36.810276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.810557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.810826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.812323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:36.812693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:36.814895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:36.837000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:36.842707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 435/865] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 23 23:08:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:36.849985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:36.859647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 431/866] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:36.915666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f440-144f-4ca1-96a7-1a53107d3726 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.916069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f440-144f-4ca1-96a7-1a53107d3726 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.916322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8f440-144f-4ca1-96a7-1a53107d3726 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.917770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 432/867] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:36.922962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:36.923246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:36.923591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:36.947159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:36.948772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:37.001320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba810f7-c56a-4388-acd1-2860a4732513 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.043810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 433/868] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:37.063199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.063199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.063199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.063199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.136223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.139522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.141302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.155173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.227346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.251137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 436/869] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:36 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:08:37.256614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.268394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcde98-8589-4e05-aace-3ef2e1c77b7a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.308413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.308689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.308968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.319607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dac35e16-92bf-49e9-a66e-df6250fdb23d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:37.325415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:37.326403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:37.327258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:37.331232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 434/870] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:37.332615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fc21-3d36-4787-a5e7-5aaf89ac746e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.332808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fc21-3d36-4787-a5e7-5aaf89ac746e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.333084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf9fc21-3d36-4787-a5e7-5aaf89ac746e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.334347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 435/871] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:37.335019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fc21-3d36-4787-a5e7-5aaf89ac746e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.368796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.371905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8ff66-021b-43da-b514-8c866784d13c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.410999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.411631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.412032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.417982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.424018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.425495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:37.443780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:37.445031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:37.446546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:37.446546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:37.446546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:37.446546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 437/872] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:37.447107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.458858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf9fc21-3d36-4787-a5e7-5aaf89ac746e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.492408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.502537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.503152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.503435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.503710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.504389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.505774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc63758-27f2-43ab-82f1-c2d47da0235a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.522287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 436/873] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:37 2022] POST /identity/v3/services => generated 251 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:37.523565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.523875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.524726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.560613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:37.562485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:37.563017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b1718-11e7-4dd0-a7cf-07b977354f9f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.616007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.616650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.616938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.617218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.618285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:37.619218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.620975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.637175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 438/874] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:37.637175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.646392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 437/875] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:37.650154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.655553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.777434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce73ba8a-cdcb-4f9c-9aaf-f70ad8172191 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.786486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb8806-d362-41fe-8e5e-b3f4f2e6b9bd None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.800739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.825062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.825821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.826109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.826397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.827057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:37.827362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.828784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.829143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:37.829886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:37.830535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:37.830885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:37.842670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 439/876] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:37.844380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:37.845864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:37.847800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:37.865715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:37.866920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:37.868561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:37.868561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:37.868561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:37.868561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 438/877] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:37.874631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:37.932134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:37.966550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2efd4-b039-4907-8b3f-5cb06d84b59d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:37.988756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809595f-80a8-4f08-bc4b-2857de3a6434 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.005268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.006023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.006353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.006628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.014969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.016694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.026043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.026829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.026948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.027173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.028052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:38.028233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.029515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:38.030722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:38.031600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:38.032575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 440/878] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:38.033652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.048922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 439/879] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:38.049644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.080018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:38.146365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c3a768-f10a-4847-aef9-694c96c52561 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.163660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5d381-d2bb-4f77-8137-58d284e37799 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.176154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:38.183679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.184314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.184593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.184868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.185521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.186902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.202474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 441/880] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:38 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:38.203334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.232832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.233950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.234504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.234985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.235989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:38.236531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.238345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.261426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 440/881] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:38.267888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.370949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f9397-8ca6-4058-b0f0-c26a2ce6c252 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.393972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:38.418103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b9e76a-8b4b-43c9-855a-2083cad2fe63 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.420863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.421582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.421935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.422281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.434475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.436692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:38.457352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:38.458390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:38.459793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 442/882] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:38.464650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.468969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.469588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.469875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.470150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.470891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=528934c45fb140dea3dc59f2056fcd5a) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:38.471204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.472680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.488008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 441/883] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:38 2022] GET /identity/v3/role_assignments?user.id=528934c45fb140dea3dc59f2056fcd5a&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:38.532563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:38.595439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f0044-8a6f-421f-a1e2-4a5f1681da98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.636732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.637299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.637586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.637864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.638647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:38.638961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.640531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:38.662471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 443/884] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:38.671967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:38.795876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb835-99b7-499c-b265-e0b0184063a9 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:38.834191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:38.834808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:38.835087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:38.835413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:38.858092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:38.928108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:38.930900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.050759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 442/885] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:38 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:08:39.056540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:39.177157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fbc72-e7e1-4291-96cc-79222310f452 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:39.188812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:39.216272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:39.216923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.217207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.217487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.228777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:39.230341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:39.246899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:39.247968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:39.249440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:39.249440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:39.249440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:39.249440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 444/886] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:39.254142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:39.309020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:39.363840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228e093-9a85-4e45-8dbe-0e1a3cfdb262 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:39.400795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:39.401413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.401835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.402200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.402912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:39.403216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:39.404626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.416609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 443/887] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:39.422094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:39.532182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbebae-3a6e-45cb-be3d-b305dbeab0ed None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:39.571012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:39.571012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.571012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.571012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.580043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:39.581618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3e1281ff-1cd6-46fd-a1bd-7f64ebc5b6cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:39.593636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:39.594538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:39.596040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 445/888] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:39.600471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:39.621772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c2f-b14a-49bd-a426-141b3864c3fe None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.622066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c2f-b14a-49bd-a426-141b3864c3fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.622322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2c2f-b14a-49bd-a426-141b3864c3fe None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.624057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 446/889] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:39.629217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873720-3e80-44de-be21-aeee58640dec None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.629504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873720-3e80-44de-be21-aeee58640dec None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.629798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873720-3e80-44de-be21-aeee58640dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.647874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-10873720-3e80-44de-be21-aeee58640dec None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:39.649102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-10873720-3e80-44de-be21-aeee58640dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:39.680110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:39.725091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81408a25-643f-4d93-9fee-953aee2f8f97 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:39.733876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 447/890] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:39 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:39.737831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:39.765150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:39.765774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.766062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.766343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.767048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:39.767360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:39.768842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.781744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 444/891] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:39.787494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873720-3e80-44de-be21-aeee58640dec None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:39.900165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873720-3e80-44de-be21-aeee58640dec None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:39.943386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:39.944620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:39.945104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:39.945582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:39.947195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] RBAC: Adding query filter params (role.id=01a39268254a496289d21a7e8b3a533a, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=3eb0da545f0548649d8f9c191dd03fc5) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:39.947926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:39.949598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:39.956550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 448/892] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:39 2022] GET /identity/v3/role_assignments?user.id=3eb0da545f0548649d8f9c191dd03fc5&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=01a39268254a496289d21a7e8b3a533a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:40.021333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.156415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b56dcd-a579-44dc-9283-934f45b24518 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:40.194613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:40.195261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.195593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.196003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.196815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:40.198193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:40.207781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:40.208851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:40.210454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 445/893] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:40.216617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.239800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:40.337178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77abd7c-fafb-43c4-8a1b-1ce8e805ace7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:40.376094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:40.376971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.377297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.377628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.378325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:40.378632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:40.380036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c692fd-2fd4-4cc3-8d57-d1c0b0994f8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:40.386902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 449/894] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:40.392163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.428491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7793-b0ca-408d-be9f-3b605fedb8a9 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.428675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7793-b0ca-408d-be9f-3b605fedb8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.428960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a7793-b0ca-408d-be9f-3b605fedb8a9 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.430749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 450/895] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:40.436776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:40.438801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.439196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.439599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.460919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:40.463154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:40.511707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04456c-969c-4abf-96ef-79ea1758cfab None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:40.559716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 451/896] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:40.560218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:40.561011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.561439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.561954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.562744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:40.563195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:40.564765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:40.575179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 446/897] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:40.581226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.593080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:40.690572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53222e94-46c0-42f7-8a44-b161ac1a36a3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:40.727791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:40.728497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.728778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.729048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.729760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] RBAC: Adding query filter params (interface=public, service_id=8903e2ceb330469790324c03b28d68e1, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:40.730068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:40.731511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffbe918-d0b7-4e9a-970e-45846ea84c48 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:40.737455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 452/898] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/endpoints?service_id=8903e2ceb330469790324c03b28d68e1&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:40.744883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.835958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85d2a-8046-4edf-9d57-c21e964167a0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.837587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85d2a-8046-4edf-9d57-c21e964167a0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.838109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f85d2a-8046-4edf-9d57-c21e964167a0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.840586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 453/899] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:40.846897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85d2a-8046-4edf-9d57-c21e964167a0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:40.860198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:40.867539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a2825-c1c2-4f7f-a57d-4885992047e1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:40.905196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:40.905825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.906112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.906387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.907005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:40.908452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ddf1b2-59d9-45f0-999b-dfe6e58158f9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:40.916166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 447/900] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:08:40.917290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:40.917586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:40.917861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:40.944339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:40.945035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:40.946917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:40.986008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f85d2a-8046-4edf-9d57-c21e964167a0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.032145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.033016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.033506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.033930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.034801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.036818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.039196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 448/901] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:41.047993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:41.049231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:41.050711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 454/902] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 23 23:08:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:41.055519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.159504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:41.170485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281f2e3-e7a6-4120-9e79-18caf40695f1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.222382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.222912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.223189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.223459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.224188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:41.224541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.226018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.231848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 449/903] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:41.237575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.343229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.345657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636a90-094b-4ee9-ba67-1f0bdac59a92 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.394442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.395913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.396647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.397161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.398243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:41.399687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.401400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.414378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 455/904] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:41.414378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:41.416473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.473892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817731e-f355-4ec1-82be-f3a65ac7fe81 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.520985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.522029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.523068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.523554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.524557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.526907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:41.539953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:41.541395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:41.542251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:41.548584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 450/905] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:41.560830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.583389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec381532-acee-4dd8-9165-2e56c6ce7b0f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.601975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:41.655385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.657716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.658862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.659900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.660651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] RBAC: Adding query filter params (interface=public, service_id=81fe2a3687ca490eaef67caaf07eaeb8, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:41.660968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.662365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.675135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 456/906] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/endpoints?service_id=81fe2a3687ca490eaef67caaf07eaeb8&interface=public®ion_id=RegionOne => generated 194 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:41.676562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.723354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ccff6-acd7-4305-b2f2-a999c4802efd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.744707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:41.764773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.766138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.766643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.767122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.768074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:41.768651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.770287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.776200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 451/907] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:41.783068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:41.797148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7769-a333-4008-807a-c8702b416c98 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.837020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.838163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.838787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.839264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.840177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.841888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7217b7e-6b0d-4751-ad7b-48a0a46232ed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.849165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 457/908] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:08:41.885286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:41.918787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4fa11c-f341-4f59-846a-1ed05d606db0 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:41.975823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:41.976854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:41.978415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:41.979092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:41.980584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:41.981395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:41.984320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118281-61de-4c13-8f0e-b5f2b313255b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:41.999909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 452/909] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:42.053087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdf7e-5067-48ff-b4fe-f185155959e3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:42.053575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdf7e-5067-48ff-b4fe-f185155959e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:42.054021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afdf7e-5067-48ff-b4fe-f185155959e3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:42.057832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 458/910] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:42.066122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:42.066424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:42.066676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:42.088925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:42.090440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:42.172404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 453/911] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:42 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:42.446732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdf7e-5067-48ff-b4fe-f185155959e3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:42.567921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afdf7e-5067-48ff-b4fe-f185155959e3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:42.598253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:42.607710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:42.608378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:42.608664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:42.608944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:42.620194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:42.624953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:42.625912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:42.627056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 459/912] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:08:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:42.632637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:42.713102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:42.737537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912b51a-1eeb-4f0f-b091-808add468fdc None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:42.773017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:42.774481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:42.774981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:42.775453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:42.776356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:42.776872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:42.778430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:42.786876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 454/913] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:08:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:42.792977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:42.902727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150dec3-1aa0-4586-860e-69c77eee0a34 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:42.938798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:42.939441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:42.939801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:42.940091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:42.951395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:42.953039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a2c29b97-8055-4c5c-ac59-5902494ff059 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:42.969974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:42.970948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:42.971897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:42.971897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:42.971897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:42.971897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 460/914] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:42.977082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.001156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07624-c2be-4985-8803-0b038b5327e3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.001752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07624-c2be-4985-8803-0b038b5327e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.001979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce07624-c2be-4985-8803-0b038b5327e3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.003468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 461/915] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:43.008837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.009556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.010072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.028898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:43.030203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:43.073031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.104327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf44d8a-0ffe-4497-a921-116262ef3a15 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.129983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 462/916] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:43 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:43.148493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.149646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.150435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.151134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.152124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:43.152628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.154211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.162618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.170164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 455/917] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:43.176715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.291792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c42e7d-5923-428f-85be-c8b50aed16bf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.331444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.332424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.332896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.333353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.341702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.343455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:43.357476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:43.358760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:43.359714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:43.362383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 463/918] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:43.368818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.425435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.466903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.490062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f22b47-3f99-44c7-8d45-2805d9bc33e4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.532557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.533606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.533810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.534188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.535059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:43.535444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.537121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.559386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c136f72-0c05-4989-a7d9-2b4b51b3f7f5 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.567251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 456/919] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:43.567556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.603934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.604977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.605467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.605947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.606749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.608408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:43.618719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:43.619991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 23 23:08:43.620863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:43.623723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 464/920] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:43.630750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.640085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.699229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138ce2c-0a48-47f7-9699-49bcf56b383d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.740094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.750186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.750186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.750186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.750481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.754698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002374f4-e53a-48eb-89ba-08f83a350dc9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.758909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.760809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:43.781404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:43.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:43.784524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:43.784524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:43.784524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:43.787517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 457/921] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:43.793647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.804338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.806393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.806886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.807371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.808817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:43.809367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.811694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.824299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 465/922] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:43.826828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:43.916394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498458d-817f-43f2-b564-a17065d91e6b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.928298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:43.963530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:43.964433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2bf53-5a6d-46f8-b727-75011386f417 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:43.964812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:43.965316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:43.965827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:43.966816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:43.968136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:43.969781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:43.986364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 458/923] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:43.993068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.005972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.006560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.006963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.007331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.008196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:44.009142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.010803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.022893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 466/924] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:44.024874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.052437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:44.125661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f325390a-2099-46a5-b0f7-7d884740733e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.138826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9b70d-b348-4680-99de-d7affdeaaed1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.163687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.164334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.164668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.164946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.171731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.173216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.176880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.177738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.178182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.178607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.179462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.181177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20c26ce-f292-4a3f-b13d-fd313aa9b873 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-638cf19f-3fc2-4643-8a81-16266e21435f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:44.184671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:44.185765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:44.186712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 459/925] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:44.187264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ae60-a9b5-4b3f-9936-b406c4b0832f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.187535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ae60-a9b5-4b3f-9936-b406c4b0832f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.187832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c7ae60-a9b5-4b3f-9936-b406c4b0832f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.189237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 460/926] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:44.193027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7ae60-a9b5-4b3f-9936-b406c4b0832f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.208972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 467/927] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:44.210240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205305f-76c0-4979-97d7-dd4349a36551 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.210528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205305f-76c0-4979-97d7-dd4349a36551 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.211089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205305f-76c0-4979-97d7-dd4349a36551 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.213238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 468/928] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:44.214471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191ed7-505b-42af-b36a-707a4d4e77be None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.214757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191ed7-505b-42af-b36a-707a4d4e77be None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.215215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26191ed7-505b-42af-b36a-707a4d4e77be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.232469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:44.237896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-26191ed7-505b-42af-b36a-707a4d4e77be None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:44.239151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26191ed7-505b-42af-b36a-707a4d4e77be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:44.326281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 469/929] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:44.328054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.328341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.328618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.332737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c7ae60-a9b5-4b3f-9936-b406c4b0832f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.340446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:44.356632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:44.359016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:44.395124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.395793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.396192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.396548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.397374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:44.398209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.400601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.420538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 461/930] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:44.428780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.463815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 470/931] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:44 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:44.527904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:44.546051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6595e4-c3fa-416a-83bc-9ec2055391c4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.583173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.583959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.584375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.584727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/3eb0da545f0548649d8f9c191dd03fc5/roles/01a39268254a496289d21a7e8b3a533a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.587771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=3eb0da545f0548649d8f9c191dd03fc5, role_id=01a39268254a496289d21a7e8b3a533a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.589346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.606704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 462/932] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:08:44 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/3eb0da545f0548649d8f9c191dd03fc5/roles/01a39268254a496289d21a7e8b3a533a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:08:44.636742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.754926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:44.757547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2537740b-ac0f-4d48-82dd-e7d1b9d191df None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.806636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.807268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.807554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.807931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.808608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.810139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.813918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:44.832682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 471/933] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:44 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:44.898652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4c723-1b44-4bdb-83a1-89db9052d80d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:44.948095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:44.948833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:44.949122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:44.949454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:44.950133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:44.951976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:44.962953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:44.964035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:44.964960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 463/934] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 23 23:08:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:44.970101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:45.091965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89882c2-96c8-40a5-887e-b8dfbfb0880e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:45.128032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:45.128807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:45.129184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:45.129559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:45.130298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:45.130728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:45.132236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:45.138776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 472/935] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:45.144430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:45.149918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:45.253817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9eb08-f136-417e-b4f9-927b8ad72a8f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:45.289834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:45.290726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:45.291181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:45.291620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:45.292437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:45.292905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:45.294426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb4847f-a15d-48ba-9001-7034918e281a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:45.300151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 464/936] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:45.308866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:45.380718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:45.430848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d3101-0f37-4b7f-a3d8-071fefc75e6d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:45.471580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:45.472242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:45.472527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:45.473076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:45.473758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:45.475138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf89fb-4288-4b0f-a637-c9b824ef4ea5 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:45.500796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 473/937] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:45 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:46.345056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe04d-63c7-4c70-a5b2-d41661385ea9 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.346535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe04d-63c7-4c70-a5b2-d41661385ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.347306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3fe04d-63c7-4c70-a5b2-d41661385ea9 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.349567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 465/938] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:46.356259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b12ff-3a14-4350-8e92-e006e2d1b8e7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.357179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b12ff-3a14-4350-8e92-e006e2d1b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.357676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b12ff-3a14-4350-8e92-e006e2d1b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.380228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ef5b12ff-3a14-4350-8e92-e006e2d1b8e7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:46.381442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ef5b12ff-3a14-4350-8e92-e006e2d1b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:46.463089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 474/939] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:46.736352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fe04d-63c7-4c70-a5b2-d41661385ea9 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:46.736789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34b5f-9ca3-40b7-acfd-a0cedc4b8b3f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.737080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34b5f-9ca3-40b7-acfd-a0cedc4b8b3f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.737356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f34b5f-9ca3-40b7-acfd-a0cedc4b8b3f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.738950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 475/940] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:46.744346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e13ae-fb5f-479f-9a4f-d92edde8738a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.744631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e13ae-fb5f-479f-9a4f-d92edde8738a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.744910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e13ae-fb5f-479f-9a4f-d92edde8738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.764869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-363e13ae-fb5f-479f-9a4f-d92edde8738a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:46.766078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-363e13ae-fb5f-479f-9a4f-d92edde8738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:46.818494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:46.819878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:46.871789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 476/941] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:46.875272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3fe04d-63c7-4c70-a5b2-d41661385ea9 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:46.914800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:46.915826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.916121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.916405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.917585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:46.920206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:46.923229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING keystone.server.flask.common [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:08:46.942519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.sql.core [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:08:46.942519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:08:46.942519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [parameters: {'id': '348ebfc420e24457a1873c5ccc2386e2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:08:46.942519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81583) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 348ebfc420e24457a1873c5ccc2386e2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 348ebfc420e24457a1873c5ccc2386e2. Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:08:46.960318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 23 23:08:46.961219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application yield resource Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise self.value Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application session.commit() Aug 23 23:08:46.962821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:08:46.963786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:08:46.964726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application result.read() Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:08:46.965546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [parameters: {'id': '348ebfc420e24457a1873c5ccc2386e2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:46.966445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:46.968740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 348ebfc420e24457a1873c5ccc2386e2. Aug 23 23:08:46.970936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:46.977793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d01a-52aa-409b-86e7-1efec42b9029 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.977793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d01a-52aa-409b-86e7-1efec42b9029 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.977793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55d01a-52aa-409b-86e7-1efec42b9029 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.979290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 466/942] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Aug 23 23:08:46 2022] POST /identity/v3/projects => generated 262 bytes in 227 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:46.979513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 477/943] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:46.979722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:46.979904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:46.979904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:46.979904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:46.990511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:46.991697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:47.091625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 478/944] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:47.105217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65285f46-6f8f-40f3-bf60-9fa34ca22e54 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.140516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:47.152622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.153475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.153902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.154119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.161773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.163465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:47.175926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:47.176872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:47.177809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 467/945] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:47.183478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.233600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.347533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51282-c600-4c3f-95c0-7c39207aa897 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.358669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:47.363788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6ba0-121e-4e91-acba-7d0dd87e78b8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.396533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.397454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.397747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.398027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.405652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.406224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.406507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.406780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.407460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:47.407781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.409288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.411058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:08:47.416674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:47.417671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:08:47.418535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:47.422912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 468/946] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:47.423904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.436293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 479/947] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:47.438279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.482841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:47.574037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f9689-df14-4786-96d2-ddd208ea438f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.593925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500ab7-285a-4612-9a40-636494a2ca0b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.623550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.624149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.624433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.624714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.625309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.626948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.637360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-833aa02d-b2c4-4dbf-ab7e-4e0078a26b84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:47.637672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:47.638800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:47.639977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:47.640923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.640923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.640923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.641154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 469/948] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:47.641237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:47.641237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.641394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185846d4-2c5e-4c16-93ef-574f51ff8a24 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.641476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4ce59-4721-4562-81f4-a237e2e2d441 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.641557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185846d4-2c5e-4c16-93ef-574f51ff8a24 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.641557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185846d4-2c5e-4c16-93ef-574f51ff8a24 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.645769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 470/949] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:47.647860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185846d4-2c5e-4c16-93ef-574f51ff8a24 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.655869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 480/950] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:47.655869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.655869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.655869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.672025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:47.673520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:47.700892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:47.760285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 481/951] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:47.764075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.777172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185846d4-2c5e-4c16-93ef-574f51ff8a24 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.788951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:47.819221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.820066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.820360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.820665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.821338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:47.821635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.823224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.829342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 471/952] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:47.838641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.905653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fcd12-13c1-47a9-951d-577f6dac4ced None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.946972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:47.947891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:47.948256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:47.948605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:47.960548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:47.962633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:47.979730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:47.980821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:47.981798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:47.981798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:47.981798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:47.985872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 482/953] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:47.987311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:47.994165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3777eeca-d249-4423-b255-a015da272bfc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:47.995692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.033670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.034436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.034818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.035218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.035989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.036507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.038082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.050066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 472/954] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.050779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.089268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.125780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9f65e-f9ef-4be9-abfa-2dc5c324d0a4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.161135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd403-5359-456e-8403-41a0273441dd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.165259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.166171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.166550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.166925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.167673 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.168162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.169910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.187036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 483/955] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.188435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.199252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.200018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.200375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.200723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.201385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.202827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:48.212762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:48.214066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:48.216529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 473/956] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:48.217361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.266152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.308065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2114edb-f87b-4960-9a5e-d5edb0559a65 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.333560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.338358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c21f1-4bf5-4320-96e9-2a91ebc2f73e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.345422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.346403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.346691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.346970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.347686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] RBAC: Adding query filter params (interface=public, service_id=118c93027a3749009c409fa6b2a60d8f, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.348032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.349542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.360788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 484/957] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/endpoints?service_id=118c93027a3749009c409fa6b2a60d8f&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.360788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.384075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.384688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.385080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.385417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.394268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.395712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:48.408559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:48.409774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 474/958] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:48.410805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.475331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b7240-0411-44fa-8e34-36aaa0f3d4a6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.503618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.515029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.515739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.516048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.516316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.516956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.517255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.518630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.521406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32a8a7-284b-4fad-9eb9-1fb55b9c8c21 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.524703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 485/959] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.525320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.565516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.566257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.566654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.567003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.567704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.569218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.577183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 475/960] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:08:48.585233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.628393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.654694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b58fc-9caa-4568-879d-890b1cd2c109 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.695428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.696940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.697488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.697934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.698744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.699132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.700831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.735892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 486/961] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.736437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ee3cf-1f05-49d7-940b-fcd96141b07c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.737327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:48.784218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.785712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.786001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.786283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:48.786933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:48.787243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:48.788663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:48.794321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 476/962] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:48.805416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:48.880906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970867dc-9d5a-43ee-8e52-7158e5eb3aa3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:48.954061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:48.955099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:48.955607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:48.956135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.087079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:49.089844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:49.184976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:49.286431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 487/963] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:08:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:08:49.293174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:49.393204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:49.408524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf738635-b0ac-479c-a6a0-d643dc5bf2ff None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:49.445497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:49.446211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:49.446495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:49.446765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.457893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:49.459340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-03151761-2329-4176-88ed-2a1979fdaad4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:08:49.473964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:49.474985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:08:49.475942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:08:49.475942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:08:49.475942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:49.475942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 477/964] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:49.481807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:49.541540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7f4a-c64b-4d20-b191-f57ddf6daf1b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:49.542201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7f4a-c64b-4d20-b191-f57ddf6daf1b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:49.542721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7f4a-c64b-4d20-b191-f57ddf6daf1b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.544853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 478/965] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:49.550000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:49.550291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:49.550572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.590538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:49.594030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:49.608167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ff0b-6582-4531-a151-38c40ccfeb55 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:49.657795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:49.658662 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:49.659091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:49.659522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.660506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:49.661077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:49.662702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:49.676733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 488/966] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:49.683146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:49.695788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 479/967] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:49.701381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:49.804787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101a022-d9a3-40a7-9dcf-7468af90f5a2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:49.847870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:49.848513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:49.848798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:49.849070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:49.857369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:49.858898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:08:49.871033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:49.872807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:49.874371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 489/968] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:49.878979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:49.955898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:49.990078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4983f6-d710-4f6d-b566-4471ae3a6af1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:49.996120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:50.028232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:50.028854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.029137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.029480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.030190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:50.030498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:50.031966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:50.044503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 480/969] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:50.050457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:50.073950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:50.108726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16b4ee-c0f6-45db-89ef-4b923784643e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:50.147475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:50.148323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.148730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.149726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.150856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:50.152576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:50.155546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING keystone.server.flask.common [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 23 23:08:50.157562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5df976-95e3-4a4d-981e-3f44ac08466b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:50.169250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.sql.core [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:08:50.169250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:08:50.169250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [parameters: {'user_id': 'cae3f23b262d4ea6b818915fd3fa30b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:08:50.169250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81584) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 23 23:08:50.177595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:08:50.178672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application yield resource Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application next(self.gen) Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.rollback() Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.force_reraise() Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise self.value Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application session.commit() Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 23 23:08:50.179877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._prepare_impl() Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.session.flush() Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._flush(objects) Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application compat.raise_( Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application flush_context.execute() Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rec.execute(self) Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 23:08:50.180958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 23:08:50.182050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result = self._query(query) Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application conn.query(q) Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application result.read() Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 23:08:50.183119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cae3f23b262d4ea6b818915fd3fa30b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:50.184288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 23 23:08:50.186698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.187843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 490/970] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 23 23:08:49 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:50.189988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:50.194177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:50.199429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:50.200337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.200884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.201330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.202303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] RBAC: Adding query filter params (role.id=01a39268254a496289d21a7e8b3a533a, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=3eb0da545f0548649d8f9c191dd03fc5) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:50.202862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:50.204581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:50.215934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 481/971] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:08:50 2022] GET /identity/v3/role_assignments?user.id=3eb0da545f0548649d8f9c191dd03fc5&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=01a39268254a496289d21a7e8b3a533a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:50.325507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feedc470-7a2b-4a3b-b741-9061649792cf None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:50.361918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:50.367146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:50.368584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.368941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.369233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.379190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:50.380944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-960bd2f9-a020-4d31-bd7a-4db64db6a4ec None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:08:50.394154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:50.395150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:50.396185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 491/972] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:08:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:50.405556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:50.521295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d1e9e-af1f-4b93-8719-5b9718896790 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:50.557860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:50.558481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.558768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.559048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.559781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:50.560109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:50.561613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a1fe8-3bce-4a80-982a-597f07e4ef2a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:50.625145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 482/973] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 23 23:08:50 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:50.790239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b903-5ee9-4a9d-b0a2-a7f69e39f2f2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.791021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b903-5ee9-4a9d-b0a2-a7f69e39f2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.791021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81b903-5ee9-4a9d-b0a2-a7f69e39f2f2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.795254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 492/974] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:50.800946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.801235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.801514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.821282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:50.822665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:50.848208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4e24-8c31-4ca8-9efc-53e9db2a6f06 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.848501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4e24-8c31-4ca8-9efc-53e9db2a6f06 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.848781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f4e24-8c31-4ca8-9efc-53e9db2a6f06 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.850402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 493/975] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:08:50.856213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:50.856499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:50.856780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:50.877889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:50.885680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:50.885680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:50.908350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 483/976] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:50.977987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 494/977] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:51.187490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:51.271487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:51.298757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d42ad0-551d-43e9-a019-5cc0da02e8d5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:51.341587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:51.342342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:51.342624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:51.342905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:51.343492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:51.344905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:51.355306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:51.356420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:51.357604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 484/978] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:51.362264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:51.385252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f397d19-3394-4436-9956-2d62cb605b61 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:51.410402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:51.412794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:51.425986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:51.426888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:51.427351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:51.427873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:51.428700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:51.430347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:51.447960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 495/979] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:51 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:08:51.484344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69aec8-b274-4e4d-a38e-b196f9307c07 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:51.535264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:51.535927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:51.536232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:51.536484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:51.537171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:51.537550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:51.538887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:51.554131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 485/980] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:51.555882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:51.693756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9597a2d4-dac3-42c1-a08a-57c7ac7bb675 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:51.763900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:51.764196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:51.767781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:51.767781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:51.767781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:51.767781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:51.771781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4e3ff-f037-479b-b504-b82dc5724eae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:51.780327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 496/981] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:51.791670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:51.925699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed339d6-16c2-41d4-b3bd-912336fbc13c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:51.934883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:51.969830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:51.969830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:51.969830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:51.970160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:51.971885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:51.972255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14accc20-3069-4b10-8824-469b5e161fd4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:51.999787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 486/982] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:52.677180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df256-6d8e-474c-a1ed-6c2e67a8df8c None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:52.677709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df256-6d8e-474c-a1ed-6c2e67a8df8c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:52.677709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984df256-6d8e-474c-a1ed-6c2e67a8df8c None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:52.679068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 497/983] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:52.685501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:52.686520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:52.686520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:52.707128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:52.709121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:52.791442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 487/984] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:52 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:53.074036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df256-6d8e-474c-a1ed-6c2e67a8df8c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:53.130155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:53.192074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984df256-6d8e-474c-a1ed-6c2e67a8df8c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:53.230091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:53.230754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:53.231037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:53.231311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:53.231946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:53.233345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:53.243927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:53.245042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:53.245897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:53.248095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 498/985] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 23 23:08:53 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:53.251299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:53.359392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:53.374611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5aae8b-ecb2-4eb7-afaf-89094c55092d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:53.409821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:53.410441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:53.410728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:53.411008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:53.412313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] RBAC: Adding query filter params (name=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:53.412313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:53.413472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962655f1-b684-4c0d-8b84-1b3f9d68b184 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:53.422411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 488/986] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:53.428061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:53.534548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722743e9-08f9-4baa-bdc4-a2c524bb7e69 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:53.546784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:53.577842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:53.578574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:53.578932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:53.579289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:53.580046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] RBAC: Adding query filter params (type=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:53.580361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:53.581744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5302cc7-d8cc-4024-b52a-e1649915ca8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:53.587810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 499/987] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:53.877986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a425-f3d4-46e3-8323-f9f93a8eb634 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:53.878511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a425-f3d4-46e3-8323-f9f93a8eb634 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:53.878802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0a425-f3d4-46e3-8323-f9f93a8eb634 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:53.880719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 489/988] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:53.887086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78c701-d2ee-4329-b260-990e489f0f3e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:53.887586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78c701-d2ee-4329-b260-990e489f0f3e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:53.887668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78c701-d2ee-4329-b260-990e489f0f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:53.908007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8f78c701-d2ee-4329-b260-990e489f0f3e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:53.909204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8f78c701-d2ee-4329-b260-990e489f0f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:53.987791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 500/989] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:54.009719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981cb4a-2768-4877-89a8-0fcdde115a1e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.009991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981cb4a-2768-4877-89a8-0fcdde115a1e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.010268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981cb4a-2768-4877-89a8-0fcdde115a1e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.011640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 490/990] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:54.017187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.017477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.017754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.037273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:54.038470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:54.146398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 501/991] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:54 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:54.271825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981cb4a-2768-4877-89a8-0fcdde115a1e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.379397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981cb4a-2768-4877-89a8-0fcdde115a1e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.415533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.416130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.416413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.416712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.417756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.419015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.422341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:54.431415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:54.432678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:54.433533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:54.436080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 491/992] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:54.438537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.458915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:54.465399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:54.548609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d229e9-eb88-4234-aa21-c5c701fbf72b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.566664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769b57-c19d-4519-8a16-0f4f3cd5c797 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.599356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.600414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.600693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.601211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.602911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.604888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.607586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.608330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.608622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.608903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.609546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:54.609858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.611226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:54.616183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:54.617160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:54.619176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:54.619953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 492/993] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:54.620027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 502/994] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:54.625340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.627024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.721040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:54.741259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d104c8c-8e4a-4970-a710-5d28a739065a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.743966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:54.749194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e687ba4-f871-4178-bd13-50d3a5c5e184 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.783880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.784491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.784773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.785044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.785678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:54.785979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.787325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.789056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.790875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.791265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.792796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.792914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] RBAC: Adding query filter params (type=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:54.793278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.795293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.800666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 493/995] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:54.801474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.803844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 503/996] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:54.810631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.926090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e77e1-e2ca-4657-bd1f-a0c9b163aede None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.929398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c038d2-c1ff-4373-be8c-ba15e4c02352 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:54.971902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.972360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:54.972532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.972750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.973032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.973691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:54.974000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.974554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:54.975198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:54.975426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.976067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:54.977911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] RBAC: Adding query filter params (interface=public, service_id=d93df26dd088448591b3d5ad05d1b1ca, region_id=RegionOne) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:54.978581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:54.980768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:54.981193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 494/997] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:54.986924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:54.989329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 504/998] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/endpoints?service_id=d93df26dd088448591b3d5ad05d1b1ca&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:54.994776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:55.004213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:55.030375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:55.115625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca118a-a6ba-438a-92cd-2e8157e17e8b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:55.135805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93db08d-e13a-4f12-9395-e1d3267a394e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:55.159127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:55.159931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:55.160216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:55.160488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:55.161196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] RBAC: Adding query filter params (interface=admin, service_id=118c93027a3749009c409fa6b2a60d8f, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:55.161502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:55.162878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:55.173817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 495/999] 10.222.0.70 () {56 vars in 1249 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/endpoints?service_id=118c93027a3749009c409fa6b2a60d8f&interface=admin®ion_id=RegionOne => generated 193 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:55.174864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:55.179283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:55.180153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:55.180792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:55.180792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:55.181228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:55.182617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adb7139-51a4-477b-bb8e-a95f17e7db32 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:55.189674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 505/1000] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:54 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:08:55.260066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:55.296360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2fda3-9942-45b8-b0e1-bfb5ec20d14e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:55.334941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:55.335560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:55.337378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:55.337378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:55.337676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:55.338953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6756170c-8ae0-4aa8-b6e7-6bf71d0e2173 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:55.347827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 496/1001] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:55 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:08:55.584815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a809-cc84-48cf-a99f-fef56e8705ba None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:55.585111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a809-cc84-48cf-a99f-fef56e8705ba None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:55.585391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9a809-cc84-48cf-a99f-fef56e8705ba None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:55.587655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 506/1002] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:55.593208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e87a-b66f-4079-8ab3-2baea430aa17 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:55.593502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e87a-b66f-4079-8ab3-2baea430aa17 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:55.593780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc46e87a-b66f-4079-8ab3-2baea430aa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:55.612697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cc46e87a-b66f-4079-8ab3-2baea430aa17 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:55.613909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cc46e87a-b66f-4079-8ab3-2baea430aa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:55.699908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 497/1003] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:55 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:55.973626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9a809-cc84-48cf-a99f-fef56e8705ba None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:56.085544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:56.099663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9a809-cc84-48cf-a99f-fef56e8705ba None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:56.148004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:56.148661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:56.148946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:56.149224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:56.149904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:56.151285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35039bf6-6ad3-4ca4-9e88-37cddcc7c75c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:56.167807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 507/1004] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:08:55 2022] POST /identity/v3/services => generated 242 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:57.350575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965a1-6f91-417b-94c5-3f530c5d21da None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:57.351110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965a1-6f91-417b-94c5-3f530c5d21da None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:57.351110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf965a1-6f91-417b-94c5-3f530c5d21da None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:57.353120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 498/1005] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:57.358501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d708d4-e0cf-42a0-93fa-3fcf733a7a77 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:57.358931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d708d4-e0cf-42a0-93fa-3fcf733a7a77 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:57.359122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d708d4-e0cf-42a0-93fa-3fcf733a7a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:57.379901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-14d708d4-e0cf-42a0-93fa-3fcf733a7a77 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:57.381105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-14d708d4-e0cf-42a0-93fa-3fcf733a7a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:57.460063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 508/1006] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:57.636551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43f33-2176-40f4-85e7-7869218111ac None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:57.636866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43f33-2176-40f4-85e7-7869218111ac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:57.637034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b43f33-2176-40f4-85e7-7869218111ac None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:57.638422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 499/1007] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:57.644085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:57.644378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:57.644653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:57.664642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:57.665978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:57.745631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b43f33-2176-40f4-85e7-7869218111ac None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:57.746242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 509/1008] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:57 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:08:57.826408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:57.883137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b43f33-2176-40f4-85e7-7869218111ac None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:57.943334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:57.944407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:57.944892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:57.945633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:57.946807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:57.949633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:57.967549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:57.968851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:57.972243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 500/1009] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 23 23:08:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:08:57.975523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:57.985278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.032783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.097951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77384ff-68f2-4bee-b590-9b1d9083036f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.138167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.138787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.139068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.139343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.140017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:58.140327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.141717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.144222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c471cf-4899-4473-a98e-0c31ac79be04 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.146877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 510/1010] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:58.153717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.186439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.192866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.193563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.193787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.194061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.194656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.196104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-1bcd78a2-7bdd-4a10-8107-7a30128c178e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:58.205740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:58.206806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:08:58.207698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 501/1011] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:08:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:58.213346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f402d3-3d16-45c0-863b-310ec46f333d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.213637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f402d3-3d16-45c0-863b-310ec46f333d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.213913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f402d3-3d16-45c0-863b-310ec46f333d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.215217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 502/1012] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:08:58.216054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f402d3-3d16-45c0-863b-310ec46f333d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.232604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.267352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3cb2-7fc0-4864-aa8f-6232127ebc72 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.302154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.302771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.303046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.303314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.303973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:58.304278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.305762 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd5f8b-f27a-4a9e-91b4-f9c0c9bfd410 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.311005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 511/1013] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 23 23:08:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:58.312476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.312740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.313013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.327341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f402d3-3d16-45c0-863b-310ec46f333d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.330689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:08:58.331906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:08:58.361784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.362411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.362687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.362965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.363601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:58.363945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.365312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.370162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 503/1014] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:58.370940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.416240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 512/1015] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:08:58 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:08:58.417115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.458979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.499459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.532141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61a592-fff8-4020-b0bf-df54e216a4a4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.549811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c1fbf-1001-4441-a6d8-0e8bdc60a4a2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.571708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.572346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.573135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.573135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.573555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.574942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.594306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 504/1016] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:58.611199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.611979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.612339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.612625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.613291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:58.613601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.615485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.623807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 513/1017] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 23 23:08:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:58.628061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.784346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:58.807605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ebf04-c435-4ac5-b27b-cea8cb53a3da None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.836999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.866108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.866725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.867004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.867850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.868892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.870261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:58.894631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 505/1018] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:08:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:08:58.935725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32695a24-348f-41ae-acaa-5f9eb7805203 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:58.967171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:58.987920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:58.988577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:58.988858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:58.989132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:58.989813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:58.991282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:08:59.002230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:08:59.003341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:08:59.004835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 514/1019] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 23 23:08:58 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:08:59.011953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:59.135954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9ea3e-fe63-4f80-b198-d4b6503b28ec None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:59.173621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:59.174246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:59.174529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:59.174808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:59.175442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:59.175744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:59.177157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:59.184998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 506/1020] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:59.190771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:59.309952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7dc26-c2a4-4261-8c16-70ca109f85fe None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:59.352759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:59.353760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:59.354265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:59.354803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:59.355643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] RBAC: Adding query filter params (type=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:59.356196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:59.357777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:59.363597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 515/1021] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:08:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:08:59.369967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:59.424114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:59.502833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2922d6-690e-4304-80e7-aa6762e64fc1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:59.538304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:59.538920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:59.539267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:59.540077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:59.541009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] RBAC: Adding query filter params (interface=public, service_id=0b1f5b32d65e43c9b66843b0e1fd1b9f, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:08:59.541227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:59.542767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2117e-0cbd-4274-8efa-10610d45832f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:59.551574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 507/1022] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:08:59 2022] GET /identity/v3/endpoints?service_id=0b1f5b32d65e43c9b66843b0e1fd1b9f&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:08:59.556720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:08:59.620345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:08:59.675828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f4932-6b33-4e97-87c0-0a76adab705d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:08:59.710444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:08:59.711592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:08:59.711949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:08:59.712214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:08:59.712778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:08:59.714155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44950692-c981-48c9-b2cf-620764e05a86 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:08:59.721270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 516/1023] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:08:59 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:09:00.610059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b897ed-9034-40f3-b2b8-e9445482bc9c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:00.610609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b897ed-9034-40f3-b2b8-e9445482bc9c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:00.610609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b897ed-9034-40f3-b2b8-e9445482bc9c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:00.612072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 508/1024] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:00.618576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9823-ab7c-44ad-be37-385d37a8223e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:00.619143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9823-ab7c-44ad-be37-385d37a8223e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:00.619143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdba9823-ab7c-44ad-be37-385d37a8223e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:00.638656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-bdba9823-ab7c-44ad-be37-385d37a8223e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:00.639907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bdba9823-ab7c-44ad-be37-385d37a8223e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:00.723798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 517/1025] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:00.982191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d43fe-1efb-46f2-9e67-153a60949629 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:00.982610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d43fe-1efb-46f2-9e67-153a60949629 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:00.982733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d43fe-1efb-46f2-9e67-153a60949629 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:00.984174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 509/1026] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:00.989936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:00.990208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:00.990452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:00.996605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d43fe-1efb-46f2-9e67-153a60949629 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:01.011102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:01.012351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:01.065046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:01.101316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 518/1027] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:00 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:01.121560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d43fe-1efb-46f2-9e67-153a60949629 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:01.123314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:01.160397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:01.161043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.161328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.161612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.162755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:01.164815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:01.167038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 510/1028] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:01.173297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:01.292382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609832e6-90c6-433e-a8e9-ffdaba1eb0fa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:01.328214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:01.328845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.329128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.329410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.330070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:01.331513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:01.365053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 519/1029] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:09:01 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:01.385610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:01.499353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe46ca-8e15-4af1-a008-0ff6fd81cae3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:01.537828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:01.538713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.539231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.540004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.551506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b7a01bb3-bd3d-4c29-919b-22f37f8dc817 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:01.556647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:01.557613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:01.558511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 511/1030] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:09:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:01.564134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:01.593939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:01.685649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e906ec2-ae42-450a-95f4-0b9cc0a7bbe6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:01.698508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d84fc-4721-4c81-89d6-191d3aa978f8 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.699022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d84fc-4721-4c81-89d6-191d3aa978f8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.699099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d84fc-4721-4c81-89d6-191d3aa978f8 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.700766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 512/1031] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:09:01.706006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.706295 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.706572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.726461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:01.728641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:01.734588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:01.735206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.735484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.735773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.736466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:01.736772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:01.738155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:01.748427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 520/1032] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:09:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:01.754689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:01.758617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:01.824540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 513/1033] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:09:01.859188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:01.877440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3930c7-0a4a-40cc-af09-a23771f0b0ed None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:01.925616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:01.926247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:01.926783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:01.926783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:01.940296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:01.941766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:01.958771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:01.966213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:01.967184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:01.967184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:01.967184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:01.967184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 521/1034] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:01.968711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.092222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.094088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc855ae-ec18-4748-b2d2-7825f6b94edd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.131539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.132196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.132483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.132763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.133432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:02.133739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.135333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.147953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 514/1035] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:02.153648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.176633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.215649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0cbc5-8a12-4233-ae98-db7915440507 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.254713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.255353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.255638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.255942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] PATH_INFO: `/v3/services/image` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.256534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.258090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.263567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19512fb-6b72-4b3a-9f61-f1171e1d79a5 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:02.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:02.268600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 23 23:09:02.269637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:02.272197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 522/1036] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/services/image => generated 86 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:02.278180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.281628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.304204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.306061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.306617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.307041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.315261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.317060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:09:02.329647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:02.330853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:02.332156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:02.334355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 515/1037] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:02.339993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.389754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055cd0b-49e6-4ea0-bb29-085ad3895954 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.426374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.427001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.427286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.427564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.428254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] RBAC: Adding query filter params (name=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:02.428571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.430116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.435625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.435907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 523/1038] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:02.440987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.463745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d30b1-1317-42e3-8a9c-efdd0ab09b7b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.513515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.514140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.514422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.514700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.515567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:02.515925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.517380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.519049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.538848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 516/1039] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:02.545229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.574384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336b1d2-8d2a-4388-8920-75479bfe8127 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.613460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.614104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.614361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.614622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.615271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] RBAC: Adding query filter params (type=image) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:02.615729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.617091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.623141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 524/1040] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:02.628955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:02.676707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d035ea1-52e5-4b7b-977e-48c72db71b62 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.717809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.718567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.718921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.719209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.728253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.740742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c465c-bc06-453a-8582-f2160b7d9b6b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:02.786031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:02.793449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:02.794077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:02.794358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:02.794644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:02.795307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.796746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.798144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:02.799838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:02.823345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 525/1041] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:09:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:09:02.939897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 517/1042] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:09:02.941315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.083268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e69e29-5a1f-4d26-9e15-374920e10a09 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.137384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:03.138442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.138931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.139420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.158408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:03.161106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:03.189826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:03.191123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:03.192585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:03.192585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:03.192585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:03.192969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 526/1043] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:03.200812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.252917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:03.351483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a8a0e-f0fb-4cac-8d82-cad207b2f214 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.392878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:03.393812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.394250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.394680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.395702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:03.396258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:03.398976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6b99a-21de-41cb-aae0-21b0b3c0dbd7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:03.419285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 518/1044] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:03.421140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.451587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c28a-5335-4eda-a3f9-68ea60550b19 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.451905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c28a-5335-4eda-a3f9-68ea60550b19 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.452110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9c28a-5335-4eda-a3f9-68ea60550b19 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.453632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 519/1045] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:09:03.458894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.459280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.459635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.459831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:03.481423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:03.482657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:03.548797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae36efa-5cc6-4f75-b097-af0ae2f2cf86 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.563304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 520/1046] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:09:03.588210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:03.588860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.589146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.589425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.596690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:03.598153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:09:03.609761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:03.610701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:03.611660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:03.615738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 527/1047] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:09:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:03.617049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.651210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:03.747831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a9eb0-8117-4095-85ad-3e814e380856 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.789733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:03.790457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.790737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.791079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.791814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:03.792202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:03.793696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:03.815091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 521/1048] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:09:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:03.817340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.841238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:03.931621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:03.946243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e779d1-3321-43b6-8091-3748ebb8457a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.961039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:03.977414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfc0b6-0ab5-4ba9-9c07-587edb591231 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:03.986539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:03.987217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:03.987499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:03.987832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:03.988554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] RBAC: Adding query filter params (role.id=01a39268254a496289d21a7e8b3a533a, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:03.988867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:03.990352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:03.997624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 528/1049] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:03 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=01a39268254a496289d21a7e8b3a533a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:04.029835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:04.030416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:04.030704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:04.030980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] PATH_INFO: `/v3/domains/default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:04.032211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:04.033690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43e9d0f-65bb-4e7c-906e-bbdfab80b9df None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:04.035549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 522/1050] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:04.041455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:04.161886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903fbea-71d7-4070-9ca9-ed5062fc8017 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:04.200610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:04.201229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:04.201507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:04.201775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:04.202438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:04.203926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63925615-c299-4aa0-868e-8324f08830ae None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:04.231827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 529/1051] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:09:04 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:04.840822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7261-a3a0-490c-a058-dbc83f778753 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:04.841360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7261-a3a0-490c-a058-dbc83f778753 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:04.841360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e7261-a3a0-490c-a058-dbc83f778753 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:04.842852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 523/1052] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:04.847982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:04.848393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:04.848589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:04.869020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:04.870219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:04.882236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:04.943705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 530/1053] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:05.215602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7261-a3a0-490c-a058-dbc83f778753 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:05.334711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e7261-a3a0-490c-a058-dbc83f778753 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:05.370578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:05.371193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:05.371475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:05.371772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:05.401537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:05.448436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:05.449892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:05.588458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 524/1054] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:05.594260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:05.749166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4947055b-6247-496e-b429-bb06ed6a5571 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:05.803230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:05.804242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:05.804698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:05.805132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:05.822771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:05.825035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:05.829434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-be97b3a2-3fb2-4da9-96a5-059c7b3d7792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:05.851387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:05.853198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:05.854163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:05.854163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:05.854163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:05.854163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 531/1055] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:05.860598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:05.922241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:05.964738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f20d-f20f-4652-8d2b-57095e8155d8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:05.965026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f20d-f20f-4652-8d2b-57095e8155d8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:05.965550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b9f20d-f20f-4652-8d2b-57095e8155d8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:05.967264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 532/1056] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:09:05.976650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6431f0-7779-4a8b-bfad-4c37eae5227c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:05.977025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6431f0-7779-4a8b-bfad-4c37eae5227c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:05.977276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6431f0-7779-4a8b-bfad-4c37eae5227c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:05.977536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006206e5-36be-4a0e-9af8-b93b1be8fa63 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:05.998386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0b6431f0-7779-4a8b-bfad-4c37eae5227c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:05.999606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0b6431f0-7779-4a8b-bfad-4c37eae5227c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:06.017748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:06.018479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.018766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.019209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.019827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:06.020135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:06.021515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954cef7-1c6e-464c-b694-edc6edf3e9bb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:06.043800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 525/1057] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:06.084532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 533/1058] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:09:06.327548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27a5a-41a5-443f-90d4-0c3f7c9483c1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.327895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27a5a-41a5-443f-90d4-0c3f7c9483c1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.328136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a27a5a-41a5-443f-90d4-0c3f7c9483c1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.329629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 526/1059] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:06.334809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.335050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.335324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.353743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:06.354909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:06.362272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a27a5a-41a5-443f-90d4-0c3f7c9483c1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.424757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 534/1060] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:06.473156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a27a5a-41a5-443f-90d4-0c3f7c9483c1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:06.490351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:06.511070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:06.511703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.512010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.512280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.523136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:06.527892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:06.529043 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:06.530055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 527/1061] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:06.535167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.620873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:06.669967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759536e0-1a02-47cb-a7da-e1e6c84cb2dc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:06.704832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:06.705617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.705787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.706060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.706455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.706742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:06.707050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:06.708467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:06.717574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 535/1062] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:06.723253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.815518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72e872-4734-44e2-84a0-8ca0928c1ac2 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:06.831671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb345f7-c1ee-4f22-a3a4-d61ac0a42319 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:06.849025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:06.854460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:06.855474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.855783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.856130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.869324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:06.869911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:06.870278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:06.870278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:06.870481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:06.874498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:06.875668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:06.877165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:06.880084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 528/1063] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:06.881794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.882092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:06.883743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:06.899190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:06.900541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:06.902239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:06.902239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:06.902239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:06.902239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 536/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:06.906334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:06.922608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:06.995543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323c07e-561a-4ee0-a3d2-f4b601fb4542 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.013288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b529-9fd5-4c5a-b8ae-180f5e4d3ed2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.030584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.031193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.031483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.031778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.032452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:07.032759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.034131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.043814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 529/1065] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.049239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.049428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.049861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.050144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.050422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.051075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:07.051385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.052805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.069631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 537/1066] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:07.070729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.101279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.146235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.150782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03473456-7f9b-4b1c-b9a9-ef52660cd30d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.173318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae01307-83c2-42ee-b0ac-1e3bfdb9fd79 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.186231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.186873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.187155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.187430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] PATH_INFO: `/v3/users/a48ca999d7684b8f982ff454024acc29` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.200923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] RBAC: Authorizing `identity:get_user(user_id=a48ca999d7684b8f982ff454024acc29)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.202387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.204106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 530/1067] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/users/a48ca999d7684b8f982ff454024acc29 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.209899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.214653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.215290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.215577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.215881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.223517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.225021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:09:07.237522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:07.238581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:07.239971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 538/1068] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:07.244485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.315469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9315ed5e-7e7c-430f-b9f5-a8cd0589b64f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.340264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.350101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ccb89a-f500-48d7-b73f-52e0637c2181 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.354990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.355707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.356007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.356228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.381260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.385417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.386032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.386307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.386577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.387327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:07.387615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.389104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.407942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 539/1069] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.413569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.426700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.428226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.514589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2b566-5b14-4d76-9ed9-b6a9e9a4e857 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.537026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 531/1070] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:09:07.543042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.549292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.549952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.550214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.550689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.561141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.562600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.572613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:07.579402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:07.585508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:07.587383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:07.587383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:07.587383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:07.587383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 540/1071] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:07.587383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.615649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.662117 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff07b-91a0-4e2d-9083-be2b00f0e9c7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.696885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.697518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.697789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.698066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.699245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.700695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.702339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 532/1072] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.707598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f36043-c42b-4e58-baca-17e4d60c7836 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.708474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.748020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.748635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.748983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.749200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.749848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:07.750157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.751822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.772501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 541/1073] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.778150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:07.809799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcad99-8916-4c34-a9d6-157b6975a98d None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.837568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.846032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:07.850869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107958-f991-496e-8249-29378a15c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.851577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107958-f991-496e-8249-29378a15c361 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.851895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107958-f991-496e-8249-29378a15c361 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.852169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107958-f991-496e-8249-29378a15c361 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.853032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107958-f991-496e-8249-29378a15c361 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user.id=a48ca999d7684b8f982ff454024acc29) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:07.853351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107958-f991-496e-8249-29378a15c361 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.854907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107958-f991-496e-8249-29378a15c361 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.866585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 533/1074] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/role_assignments?user.id=a48ca999d7684b8f982ff454024acc29&scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:07.895520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeefc7ee-0793-4514-83a4-3dec189c68d3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:07.934610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:07.935087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:07.935372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:07.935650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:07.943329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:07.944944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:09:07.958780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:07.959851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:07.961007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 542/1075] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:09:07.966221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107958-f991-496e-8249-29378a15c361 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:08.087746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107958-f991-496e-8249-29378a15c361 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:08.124637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:08.124637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:08.125423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:08.125423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:08.125731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:08.126041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:08.127743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f9e94d-1743-4e79-894e-c5e12b76b410 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:08.139935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 534/1076] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:09:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:08.145967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:08.256154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33153a-91bc-4b48-b27a-de37e3d1d787 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:08.276612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:08.292756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:08.293424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:08.293706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:08.293984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/01a39268254a496289d21a7e8b3a533a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:08.296156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=6aee1815f27f44e5a738eda3234595e6, role_id=01a39268254a496289d21a7e8b3a533a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:08.297612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f1559-e301-4879-9878-18a7b4280b5b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:08.311937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 543/1077] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:09:08 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/6aee1815f27f44e5a738eda3234595e6/roles/01a39268254a496289d21a7e8b3a533a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:09:09.771166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9081f-1d22-4b5c-9f60-c14b6d49ce86 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:09.771719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9081f-1d22-4b5c-9f60-c14b6d49ce86 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:09.771719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9081f-1d22-4b5c-9f60-c14b6d49ce86 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:09.773271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 535/1078] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:09.778559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95f74-836c-4de8-a3f8-c3a6a4809b9c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:09.778968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95f74-836c-4de8-a3f8-c3a6a4809b9c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:09.779119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb95f74-836c-4de8-a3f8-c3a6a4809b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:09.797603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-dbb95f74-836c-4de8-a3f8-c3a6a4809b9c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:09.798788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-dbb95f74-836c-4de8-a3f8-c3a6a4809b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:09.865016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 544/1079] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:10.134288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9081f-1d22-4b5c-9f60-c14b6d49ce86 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.184950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.228356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6837522-f310-4170-ab1e-e5606ab11a05 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.228650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6837522-f310-4170-ab1e-e5606ab11a05 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.228956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6837522-f310-4170-ab1e-e5606ab11a05 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.230312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 545/1080] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:10.235299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.235585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.235893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.239063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9081f-1d22-4b5c-9f60-c14b6d49ce86 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.254407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:10.255600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:10.287243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.287917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.288220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.288492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.301124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:10.306542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:10.307710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:10.308765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 536/1081] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:10.317190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.330302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 546/1082] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:09:10.417326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1deb2-b92f-4671-bdcd-cffa298e91b4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.425957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.451738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.452364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.452646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.452919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.453581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:10.453883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:10.455235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:10.463841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 537/1083] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:10.469516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.510891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.572137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff700c4-3074-44a2-8761-9b5685fc021d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.606642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.607281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.607560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.607868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] PATH_INFO: `/v3/users/a48ca999d7684b8f982ff454024acc29` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.609001 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] RBAC: Authorizing `identity:get_user(user_id=a48ca999d7684b8f982ff454024acc29)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:10.609568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.610429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:10.612203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 547/1084] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/users/a48ca999d7684b8f982ff454024acc29 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:10.617862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.719774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b64b970-60b3-4dbb-924e-ca696b159255 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.721879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87780335-cc93-49d4-a1cc-2397ba533f2a None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.730672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.753885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.754511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.754791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.755124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.756641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.757409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.758659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.758972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.760142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:10.761578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:10.763199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 548/1085] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:10.769124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.770157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:10.775021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:10.776538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:10.777421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 538/1086] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:10.782358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.813629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:10.869936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e942c3-2c64-47c9-8001-51e500621766 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.883630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd63cc3-2ea9-4bd4-b069-1dda7be5f67f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:10.903712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.904395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.904699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.904999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8/users/a48ca999d7684b8f982ff454024acc29/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.906895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user_id=a48ca999d7684b8f982ff454024acc29, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:10.908373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:10.918570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:10.919281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:10.919628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:10.919987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:10.920660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:10.920963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:10.933184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 549/1087] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:09:10 2022] PUT /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8/users/a48ca999d7684b8f982ff454024acc29/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:09:10.933430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:10.933430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 539/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:10.939091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:10.990319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:11.083812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae7976-e475-40e0-957d-0b986b0a87a3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:11.128330 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:11.129397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:11.129893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:11.130315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:11.141855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:11.143343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:11.161232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:11.162285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:11.163216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:11.163216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:11.163216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:11.163216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 550/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:11.171250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:11.278325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:11.289690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d7906-e3af-4fa5-9d0b-799895673895 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:11.333503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:11.334118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:11.334405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:11.334705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:11.335365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:11.336029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:11.337577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:11.357572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 540/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:11.358851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:11.451148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:11.464895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4c923-8b18-4ebc-9c07-8bf9d6434d94 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:11.500785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:11.501447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:11.501998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:11.502274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:11.511008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:11.512529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:09:11.525595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:11.526834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:11.527882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 551/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 23 23:09:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:11.533129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:11.642280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12db58-0f50-46e7-8eb7-d8274d8be9ae None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:11.677685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:11.678301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:11.678585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:11.678859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:11.679802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:11.680207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:11.681730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:11.704128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 541/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 23 23:09:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:11.705556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:11.808210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99fff8d-b811-4663-ae49-313159ae43b0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:11.844753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:11.845411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:11.845696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:11.845971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:11.865114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:11.918788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:11.920313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.037192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 552/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:12.043656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:12.057577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:12.150359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefdde1d-38ac-451f-b462-4a2903850219 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:12.185989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:12.186627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.186912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.187190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.199046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:12.200549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:12.219253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:12.220464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:09:12.221404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:12.221404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:09:12.221404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:12.221404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 542/1094] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:12.226567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:12.285411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:12.343262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a63e5-22c9-45d4-90aa-1eacb66d493c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:12.379092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:12.379712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.380020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.380293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.380956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:12.381261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:12.383290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.395597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 553/1095] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:12.401558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:12.464313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:12.508229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f217d-538d-4e62-a5d8-18ea5d8db82a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:12.545435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:12.546085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.546463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.546667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.554327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:12.556529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:09:12.568503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:12.569722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:12.576698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 543/1096] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:12.577720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:12.687113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dab776-e4f2-4045-b719-189b43d14b09 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:12.696923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:12.723258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:12.723912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.724198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.724474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.725178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:12.725487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:12.726981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51312a74-7966-4abe-b527-48c3fd19f489 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.739222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 554/1097] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:12.745409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:12.851419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef27a95-58fb-45e8-a30a-014f7af59a7a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:12.874448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:12.888559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:12.889187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.889473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.889747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.890496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] RBAC: Adding query filter params (role.id=01a39268254a496289d21a7e8b3a533a, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=6aee1815f27f44e5a738eda3234595e6) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:12.890812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:12.892314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ddd5-c249-4b16-ae7d-6ae8092d8cec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:12.907982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 544/1098] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:12 2022] GET /identity/v3/role_assignments?user.id=6aee1815f27f44e5a738eda3234595e6&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=01a39268254a496289d21a7e8b3a533a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:12.952587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65630-41a2-4291-9172-e77407981820 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.953139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65630-41a2-4291-9172-e77407981820 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.953139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce65630-41a2-4291-9172-e77407981820 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.954492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 555/1099] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:12.961016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:12.961872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:12.962261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:12.982971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:12.984280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:13.065809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 545/1100] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:13.340552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce65630-41a2-4291-9172-e77407981820 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:13.450408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce65630-41a2-4291-9172-e77407981820 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:13.490164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:13.490826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:13.491114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:13.491403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:13.503787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:13.509125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:13.510303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:13.511372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 556/1101] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:13.516839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:13.633069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f53e-5125-4bad-bbd9-0f7254ec82ce None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:13.650934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:13.674697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:13.675319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:13.675603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:13.675913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:13.676605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:13.676900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:13.678292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:13.688274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 546/1102] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:13.694417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:13.725746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:13.807370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9ae6f-c0e3-437f-8625-a15dc4ec13b7 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:13.843190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:13.843860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:13.844147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:13.844422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] PATH_INFO: `/v3/users/a48ca999d7684b8f982ff454024acc29` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:13.845555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] RBAC: Authorizing `identity:get_user(user_id=a48ca999d7684b8f982ff454024acc29)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:13.847007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:13.848648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 557/1103] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:13 2022] GET /identity/v3/users/a48ca999d7684b8f982ff454024acc29 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:13.855560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:13.970456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3c28-0fd1-40fe-bf26-6e9b2a8f1300 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:14.006597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:14.007218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:14.008015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:14.008300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:14.056315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:14.079373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:14.080898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:14.183522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 547/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:14.189716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:14.298539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:14.304854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff241b-e929-45c9-ac51-012cc2886481 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:14.341495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:14.342135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:14.342416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:14.342692 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:14.343840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:14.345286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd853f9c-a54b-487d-8808-559e7eee8b37 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:14.346935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 558/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:14 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:14.353381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:14.431735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:14.454986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21511d4-843e-496e-915c-0f451f84165b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:14.490487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:14.491103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:14.491386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:14.491660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:14.492948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user.id=a48ca999d7684b8f982ff454024acc29) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:14.493254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:14.494701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f7653-0a39-4ad2-9afd-7a1011fe04e2 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:14.500909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 548/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:14 2022] GET /identity/v3/role_assignments?user.id=a48ca999d7684b8f982ff454024acc29&scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:16.463825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7770-563e-4e11-9e08-fbc4d1cc71ce None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:16.464401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7770-563e-4e11-9e08-fbc4d1cc71ce None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:16.464401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7770-563e-4e11-9e08-fbc4d1cc71ce None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:16.465741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 559/1107] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:16.471110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:16.471541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:16.471654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:16.489837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:16.491041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:16.559675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 549/1108] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:16.833357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7770-563e-4e11-9e08-fbc4d1cc71ce None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:16.935304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7770-563e-4e11-9e08-fbc4d1cc71ce None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:16.971367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:16.972022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:16.972305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:16.972577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:16.973677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:16.975146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82675da3-138c-4f97-85c7-aef37ab59645 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:16.977482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 560/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:16.983342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:17.051320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:17.081265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e99c9-2c60-4ea5-a6e8-182cea470653 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:17.114358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:17.114964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:17.115268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:17.115526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:17.116208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:17.117663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d9d80-3dbc-45df-bfe2-8ccae25940ed None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:17.139237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 550/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:09:16 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:19.092816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daef5-ef5d-4931-bccd-236c8294dcde None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:19.093573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daef5-ef5d-4931-bccd-236c8294dcde None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:19.093573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2daef5-ef5d-4931-bccd-236c8294dcde None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:19.094713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 561/1111] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:19.100358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:19.100834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:19.100930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:19.119728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:19.120971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:19.190215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 551/1112] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:19.485995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2daef5-ef5d-4931-bccd-236c8294dcde None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:19.517698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:19.589352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2daef5-ef5d-4931-bccd-236c8294dcde None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:19.622447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:19.623120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:19.623558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:19.623892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] PATH_INFO: `/v3/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:19.625277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] RBAC: Authorizing `identity:get_role(role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:19.626902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:19.628253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 562/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:19 2022] GET /identity/v3/roles/6cc679021d904431823a4fe019f8ddcb => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:19.634670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:19.696640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:19.737704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f413322-381a-4303-be1f-80dbf581f34d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:19.772006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:19.772632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:19.772915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:19.773215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] PATH_INFO: `/v3/users/c52fe3e383da44148eae5bf305ebf830` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:19.786115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] RBAC: Authorizing `identity:get_user(user_id=c52fe3e383da44148eae5bf305ebf830)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:19.787554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:19.789403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 552/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:19 2022] GET /identity/v3/users/c52fe3e383da44148eae5bf305ebf830 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:19.795516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:19.892172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:19.895431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e32c8-1882-4ced-b177-29a6d2ccfa93 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:19.928640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:19.929787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:19.930251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:19.930491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:19.997546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:19.998926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:20.091015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:20.094559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 563/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:20.100530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:20.199707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e33314-2234-4b99-84e6-68889d6682ba None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:20.216060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:20.234233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:20.234867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:20.235146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:20.235419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:20.236708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:20.238128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b8b41e-1822-4c94-8945-b38864806e6b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:20.239763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 553/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:20 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:20.246859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:20.347173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616ff69-968b-4295-b088-35c99b9c890f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:20.381908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:20.382530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:20.382836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:20.383109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:20.383857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user.id=c52fe3e383da44148eae5bf305ebf830) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:20.385891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:20.387333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0aad4-9f02-433b-8475-d81bd2a71d6f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:20.392672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 564/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:20 2022] GET /identity/v3/role_assignments?user.id=c52fe3e383da44148eae5bf305ebf830&scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8&role.id=6cc679021d904431823a4fe019f8ddcb => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:22.280767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf98be-1ef1-496d-962c-8d242d836d64 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:22.281334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf98be-1ef1-496d-962c-8d242d836d64 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:22.281334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf98be-1ef1-496d-962c-8d242d836d64 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:22.282682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 554/1118] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:22.287848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:22.288258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:22.288411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:22.306981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:22.308186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:22.370660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:22.380656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 565/1119] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:22.649844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf98be-1ef1-496d-962c-8d242d836d64 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:22.749715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf98be-1ef1-496d-962c-8d242d836d64 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:22.782892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:22.783518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:22.783828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:22.784105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] PATH_INFO: `/v3/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:22.785503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] RBAC: Authorizing `identity:get_role(role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:22.786873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:22.788237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 555/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:22 2022] GET /identity/v3/roles/6cc679021d904431823a4fe019f8ddcb => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:22.794478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:22.892721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e87dda-0a62-4d4b-9a6f-e2edadef28fc None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:22.925104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:22.925730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:22.926010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:22.926287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] PATH_INFO: `/v3/users/c52fe3e383da44148eae5bf305ebf830` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:22.927396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] RBAC: Authorizing `identity:get_user(user_id=c52fe3e383da44148eae5bf305ebf830)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:22.928856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:22.931176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 566/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:22 2022] GET /identity/v3/users/c52fe3e383da44148eae5bf305ebf830 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:22.937155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:22.989416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:23.037648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf06af0-792d-47f4-93e4-364f7437d14f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:23.072389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:23.073024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:23.073306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:23.073583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:23.074694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:23.076160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3489bd-c95f-4b0e-8f0e-51fe48f11f12 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:23.077791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 556/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:22 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:23.083731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:23.144783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:23.184017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f46dd-f9e3-46f0-ba23-73c260a8704b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:23.218302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4295648-2230-4928-902d-71768dc9217f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:23.218956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295648-2230-4928-902d-71768dc9217f None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:23.219240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295648-2230-4928-902d-71768dc9217f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:23.219515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4295648-2230-4928-902d-71768dc9217f None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8/users/c52fe3e383da44148eae5bf305ebf830/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:23.221678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4295648-2230-4928-902d-71768dc9217f None admin] RBAC: Authorizing `identity:create_grant(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user_id=c52fe3e383da44148eae5bf305ebf830, role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:23.223121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4295648-2230-4928-902d-71768dc9217f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:23.236158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 567/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:09:23 2022] PUT /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8/users/c52fe3e383da44148eae5bf305ebf830/roles/6cc679021d904431823a4fe019f8ddcb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:09:25.110179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025876-9ae9-4195-b0ca-a5ab7bcf7439 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:25.110736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025876-9ae9-4195-b0ca-a5ab7bcf7439 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:25.110736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27025876-9ae9-4195-b0ca-a5ab7bcf7439 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:25.112201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 557/1124] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:25.118215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:25.118648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:25.118745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:25.137175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:25.138348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:25.202174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 568/1125] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:25.469638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025876-9ae9-4195-b0ca-a5ab7bcf7439 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:25.569128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27025876-9ae9-4195-b0ca-a5ab7bcf7439 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:25.589215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:25.603634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:25.604294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:25.604580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:25.604856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] PATH_INFO: `/v3/roles/6cc679021d904431823a4fe019f8ddcb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:25.606243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] RBAC: Authorizing `identity:get_role(role_id=6cc679021d904431823a4fe019f8ddcb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:25.607604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:25.608970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 558/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:25 2022] GET /identity/v3/roles/6cc679021d904431823a4fe019f8ddcb => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:25.614852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:25.667309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:25.713719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4be82f-1d54-43f0-8c6a-b25490998827 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:25.749618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:25.750156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:25.750431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:25.750699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] PATH_INFO: `/v3/users/c52fe3e383da44148eae5bf305ebf830` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:25.752302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] RBAC: Authorizing `identity:get_user(user_id=c52fe3e383da44148eae5bf305ebf830)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:25.753924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:25.755504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 569/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:25 2022] GET /identity/v3/users/c52fe3e383da44148eae5bf305ebf830 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:25.762078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:25.860198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098de95e-154b-4618-a44d-e5fd5a5967f6 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:25.893285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:25.893886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:25.894171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:25.894453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:25.948033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:25.961697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:25.963147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:26.058921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 559/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:26.064797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:26.163972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c789f-8e6e-49db-a4bd-a1f4274df5df None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:26.182626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:26.196992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:26.197619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:26.197896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:26.198166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] PATH_INFO: `/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:26.199248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] RBAC: Authorizing `identity:get_project(project_id=8b1721ba7d8f4c688c2debc8eaa5a3f8)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:26.200721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d7144-4eb6-4185-ac58-e74bf111f77b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:26.202334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 570/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:26 2022] GET /identity/v3/projects/8b1721ba7d8f4c688c2debc8eaa5a3f8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:26.208535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:26.294144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:26.306466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b1e92-516d-497f-aee3-61c6dc4fbab4 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:26.340444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:26.341039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:26.341322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:26.341599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:26.342322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] RBAC: Adding query filter params (role.id=6cc679021d904431823a4fe019f8ddcb, scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8, user.id=c52fe3e383da44148eae5bf305ebf830) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:26.342637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:26.344103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f10086-e347-41ed-81c8-7f72ff2c6fa8 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:26.349678 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 560/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:26 2022] GET /identity/v3/role_assignments?user.id=c52fe3e383da44148eae5bf305ebf830&scope.project.id=8b1721ba7d8f4c688c2debc8eaa5a3f8&role.id=6cc679021d904431823a4fe019f8ddcb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:28.279432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3055-8554-410b-b7ea-8b2e5df4c42e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:28.280037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3055-8554-410b-b7ea-8b2e5df4c42e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:28.280037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c3055-8554-410b-b7ea-8b2e5df4c42e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:28.281357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 571/1131] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:28.286477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:28.286871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:28.287031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:28.304748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:28.305937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:28.372110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 561/1132] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:28.643809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3055-8554-410b-b7ea-8b2e5df4c42e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:28.744481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c3055-8554-410b-b7ea-8b2e5df4c42e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:28.777406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:28.778024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:28.778303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:28.778576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:28.779674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:28.781141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2df262-ded1-4786-aac7-240f5db7a7a0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:28.782689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 572/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:28.788602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:28.869803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:28.888407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216c77c5-c41b-4c64-9dbc-432f4f7665db None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:28.921431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:28.922040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:28.922327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:28.922605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:28.923249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:28.924714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc0457-efef-44a5-8e66-5f8b7f5a0d32 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:28.954413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 562/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:09:28 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:30.884204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a403c-f385-4625-8126-4a1460ca9945 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:30.884731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a403c-f385-4625-8126-4a1460ca9945 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:30.884731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a403c-f385-4625-8126-4a1460ca9945 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:30.886068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 573/1135] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:30.891497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:30.891976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:30.892084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:30.910417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:30.911607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:30.978927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 563/1136] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:31.248230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a403c-f385-4625-8126-4a1460ca9945 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:31.304872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:31.348842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a403c-f385-4625-8126-4a1460ca9945 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:31.381866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:31.383134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:31.383419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:31.383691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:31.384836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:31.386268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e90dc-edab-402d-8e50-184b89091a18 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:31.387852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 574/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:09:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:31.393699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:31.453813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:31.492831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6441f1-990f-4f73-988d-e311e1fa806a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:31.526942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:31.527477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:31.527790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:31.528070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:31.528723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:31.530163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31824f1-e228-4096-ae53-1499544f97f9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:31.550338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 564/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:09:31 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:33.466701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf80-97bf-4132-a0a7-eeaad62337aa None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:33.467243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf80-97bf-4132-a0a7-eeaad62337aa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:33.467243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cfcf80-97bf-4132-a0a7-eeaad62337aa None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:33.468709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 575/1139] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:33.475129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:33.475580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:33.475713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:33.498245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:33.499450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:33.564805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 565/1140] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:33.831249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcf80-97bf-4132-a0a7-eeaad62337aa None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:33.931766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cfcf80-97bf-4132-a0a7-eeaad62337aa None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:33.954351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:33.966099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:33.966719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:33.966996 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:33.967265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:33.977985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:33.982650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:33.983608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:33.984590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 576/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:33.989782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:34.037945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:34.088011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac233ef-528c-4931-8278-d534c11d26f3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:34.122095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:34.122697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:34.122981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:34.123258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:34.123961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:34.124268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:34.125636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:34.133924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 566/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:34.139992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:34.239247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb1344-2690-4555-a500-703a3c401cf9 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:34.273410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:34.274060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:34.274342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:34.274616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] PATH_INFO: `/v3/users/4e96aaa8e66f40a5b8923ab9e156e978` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:34.287412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] RBAC: Authorizing `identity:get_user(user_id=4e96aaa8e66f40a5b8923ab9e156e978)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:34.289015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:34.290628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 577/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:34 2022] GET /identity/v3/users/4e96aaa8e66f40a5b8923ab9e156e978 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:34.296538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:34.394510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9df6fc-acc9-46e9-b098-f5386ba4c599 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:34.407366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:34.428240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:34.428876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:34.429362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:34.429642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:34.496149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:34.497593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:34.596020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 567/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:34.602305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:34.645129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:34.701023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f321afd-9e36-44d1-a461-dfc98f4fc52c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:34.734329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:34.734956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:34.735243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:34.735517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] PATH_INFO: `/v3/projects/7d98213c6b4d42f088942e9561f8e7a7` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:34.736668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] RBAC: Authorizing `identity:get_project(project_id=7d98213c6b4d42f088942e9561f8e7a7)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:34.738101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54309f09-69e2-4d11-a78e-794552141202 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:34.739726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 578/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:34 2022] GET /identity/v3/projects/7d98213c6b4d42f088942e9561f8e7a7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:09:34.746480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:34.761513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:34.847126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1175ad1-49d1-423f-bf09-f8c9f8104290 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:34.880747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:34.881348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:34.881633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:34.882644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:34.883621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=7d98213c6b4d42f088942e9561f8e7a7, user.id=4e96aaa8e66f40a5b8923ab9e156e978) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:34.883949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:34.885373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e853c4-429c-4905-95db-326472859f94 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:34.890644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 568/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:34 2022] GET /identity/v3/role_assignments?user.id=4e96aaa8e66f40a5b8923ab9e156e978&scope.project.id=7d98213c6b4d42f088942e9561f8e7a7&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:36.760503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269fbf-d045-4a8d-8094-897741377da4 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:36.761053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269fbf-d045-4a8d-8094-897741377da4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:36.761053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7269fbf-d045-4a8d-8094-897741377da4 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:36.762395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 579/1147] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:36.767453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:36.767858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:36.768047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:36.785700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:36.786884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:36.852539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 569/1148] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:37.119323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269fbf-d045-4a8d-8094-897741377da4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:37.220970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7269fbf-d045-4a8d-8094-897741377da4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:37.231569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:37.255469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:37.256116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:37.256395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:37.256664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:37.267192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:37.271838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:37.272954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:37.273935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 580/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:37.279277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:37.292615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:37.381858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8fa23-6eaa-4c12-b778-c1de4fd05bde None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:37.414691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:37.415287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:37.415570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:37.415874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:37.416541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:37.416847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:37.418209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:37.425944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 570/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:37.432622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:37.534821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af4b5d-210f-458c-9440-3ad774cb9c19 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:37.569623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:37.570399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:37.570665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:37.570941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] PATH_INFO: `/v3/users/4e96aaa8e66f40a5b8923ab9e156e978` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:37.572116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] RBAC: Authorizing `identity:get_user(user_id=4e96aaa8e66f40a5b8923ab9e156e978)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:37.573554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:37.575141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 581/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:37 2022] GET /identity/v3/users/4e96aaa8e66f40a5b8923ab9e156e978 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:37.580854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:37.647977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:37.681879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea191b-e15f-47fc-b8ee-8001feb80f58 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:37.714341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:37.714960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:37.715239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:37.715515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] PATH_INFO: `/v3/projects/7d98213c6b4d42f088942e9561f8e7a7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:37.716635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] RBAC: Authorizing `identity:get_project(project_id=7d98213c6b4d42f088942e9561f8e7a7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:37.718055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32a537f-a5d2-40dd-bd95-d16d914835cf None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:37.719670 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 571/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:37 2022] GET /identity/v3/projects/7d98213c6b4d42f088942e9561f8e7a7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:37.726377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:37.764663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:37.823319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83b072-b90b-4391-a198-e18cca13655c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:37.859290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:37.859971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:37.860253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:37.860527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] PATH_INFO: `/v3/projects/7d98213c6b4d42f088942e9561f8e7a7/users/4e96aaa8e66f40a5b8923ab9e156e978/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:37.862396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d98213c6b4d42f088942e9561f8e7a7, user_id=4e96aaa8e66f40a5b8923ab9e156e978, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:37.863851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587974a-3222-47ce-b581-98b171c13874 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:37.877141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 582/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:09:37 2022] PUT /identity/v3/projects/7d98213c6b4d42f088942e9561f8e7a7/users/4e96aaa8e66f40a5b8923ab9e156e978/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:09:39.771647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29de70-965a-4722-81e7-0f6dfb43f595 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:39.772225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29de70-965a-4722-81e7-0f6dfb43f595 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:39.772225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29de70-965a-4722-81e7-0f6dfb43f595 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:39.774404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 572/1154] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:39.779639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:39.780070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:39.780261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:39.797956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:39.799146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:39.864400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 583/1155] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:40.139251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29de70-965a-4722-81e7-0f6dfb43f595 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:40.246145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29de70-965a-4722-81e7-0f6dfb43f595 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:40.280244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:40.280867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:40.281153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:40.281429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:40.284093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:40.293040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:40.297706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:40.298865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:40.300063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 573/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:40.304947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:40.332387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:40.404656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1c5a6-69ba-4446-bd2f-33bbaa565575 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:40.438401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:40.439005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:40.439286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:40.439559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:40.440263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:40.440568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:40.441937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:40.450472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 584/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:40.456333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:40.554428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c905c2-3ebe-4277-9b01-156f75ed92e8 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:40.588007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:40.588635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:40.588917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:40.589192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] PATH_INFO: `/v3/users/4e96aaa8e66f40a5b8923ab9e156e978` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:40.590315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] RBAC: Authorizing `identity:get_user(user_id=4e96aaa8e66f40a5b8923ab9e156e978)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:40.591737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:40.593359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 574/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:40 2022] GET /identity/v3/users/4e96aaa8e66f40a5b8923ab9e156e978 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:40.599317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:40.690875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:40.701053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f684e1-5e8d-49ce-9de0-93da80eaa87f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:40.733761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:40.734371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:40.734652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:40.734926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:40.800207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:40.801656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:40.889341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:40.899974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 585/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:40.905983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:40.966841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:41.004854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3057b7e-9853-4181-a2ff-3f43711e6c4a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:41.037422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:41.038643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:41.038844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:41.039126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] PATH_INFO: `/v3/projects/7d98213c6b4d42f088942e9561f8e7a7` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:41.040263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] RBAC: Authorizing `identity:get_project(project_id=7d98213c6b4d42f088942e9561f8e7a7)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:41.041693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a65e4-230f-40c5-8ee8-0176ccf62a4a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:41.043327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 575/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:40 2022] GET /identity/v3/projects/7d98213c6b4d42f088942e9561f8e7a7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:41.049500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:41.146810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b16e0-3936-4d0b-aae5-1a8c48d88561 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:41.181261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:41.181858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:41.182171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:41.182447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:41.183171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=7d98213c6b4d42f088942e9561f8e7a7, user.id=4e96aaa8e66f40a5b8923ab9e156e978) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:41.183482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:41.184958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43accf5-81dd-41c9-9845-a408aca3f4fb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:41.190703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 586/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:41 2022] GET /identity/v3/role_assignments?user.id=4e96aaa8e66f40a5b8923ab9e156e978&scope.project.id=7d98213c6b4d42f088942e9561f8e7a7&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:43.121049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b6d0-bd8a-4487-9f93-fbcd2230b080 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:43.121607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b6d0-bd8a-4487-9f93-fbcd2230b080 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:43.121607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6334b6d0-bd8a-4487-9f93-fbcd2230b080 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:43.122951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 576/1162] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:43.128650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400953d-818b-4196-9f08-87397a92097e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:43.129050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400953d-818b-4196-9f08-87397a92097e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:43.129204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7400953d-818b-4196-9f08-87397a92097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:43.147333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7400953d-818b-4196-9f08-87397a92097e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:43.148791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7400953d-818b-4196-9f08-87397a92097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:43.197124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:43.213970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 587/1163] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:43.482744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b6d0-bd8a-4487-9f93-fbcd2230b080 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:43.585088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6334b6d0-bd8a-4487-9f93-fbcd2230b080 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:43.614873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:43.621271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:43.621879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:43.622158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:43.622430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:43.687951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:43.689386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:43.782799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 577/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:43.789619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400953d-818b-4196-9f08-87397a92097e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:43.885647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7400953d-818b-4196-9f08-87397a92097e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:43.921063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:43.921690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:43.921973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:43.922248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:43.929244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:43.930689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-a9e52614-e48c-465a-8bb9-cf20adfe0004 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:43.943274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:43.944555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:09:43.945690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 588/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:09:43 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:43.950476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:43.982312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:44.050646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bb4184-1ab7-4514-a11f-3eefedd0611b None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:44.085406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:44.086015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:44.086331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:44.086614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:44.087255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:44.087561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:44.088963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa199f87-2a07-479e-800a-89aa1de50970 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:44.096113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 578/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 23 23:09:43 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:46.001313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15bf0-d43c-4d4e-85ad-5207903ce43d None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:46.002131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15bf0-d43c-4d4e-85ad-5207903ce43d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:46.002131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b15bf0-d43c-4d4e-85ad-5207903ce43d None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:46.003455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 589/1167] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:46.009574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098201be-250c-49fd-831f-dd9805309b12 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:46.009999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098201be-250c-49fd-831f-dd9805309b12 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:46.010108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098201be-250c-49fd-831f-dd9805309b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:46.027916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-098201be-250c-49fd-831f-dd9805309b12 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:46.029087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-098201be-250c-49fd-831f-dd9805309b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:46.093500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 579/1168] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:46.363567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b15bf0-d43c-4d4e-85ad-5207903ce43d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:46.410601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:46.464770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b15bf0-d43c-4d4e-85ad-5207903ce43d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:46.497987 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:46.498584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:46.498862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:46.499131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:46.499798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:46.501153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c61a6-9a79-4b76-9ca9-d0d60cc8f991 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:46.516974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 590/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Tue Aug 23 23:09:46 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:48.440627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9277-70ed-4651-8dfa-7825ac6cfc7f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:48.441176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9277-70ed-4651-8dfa-7825ac6cfc7f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:48.441176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e9277-70ed-4651-8dfa-7825ac6cfc7f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:48.442554 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 580/1170] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:48.448105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:48.448531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:48.448814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:48.466885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:48.468081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:48.533695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 591/1171] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:48.808483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e9277-70ed-4651-8dfa-7825ac6cfc7f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:48.837163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:48.911909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e9277-70ed-4651-8dfa-7825ac6cfc7f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:48.945316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:48.945941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:48.946225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:48.946503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] PATH_INFO: `/v3/domains/3ed9cd426a52421bbb77108dbc87cb49` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:48.956616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3ed9cd426a52421bbb77108dbc87cb49)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:48.958057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574fea2-2c52-474f-93e1-6bb054526193 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:48.960393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 581/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Aug 23 23:09:48 2022] GET /identity/v3/domains/3ed9cd426a52421bbb77108dbc87cb49 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:48.966320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:48.999004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:49.067600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ad3bf-25b5-404f-8172-9317237c685f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:49.103052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:49.103671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:49.103980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:49.104258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:49.104907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:49.106345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2be03-6c0a-4925-8435-46a9f78ac802 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:49.133091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 592/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:09:48 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:51.060048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94245455-d61c-4ffd-b763-a6bfa53e705a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:51.060617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94245455-d61c-4ffd-b763-a6bfa53e705a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:51.060617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94245455-d61c-4ffd-b763-a6bfa53e705a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:51.061953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 582/1174] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:51.067085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:51.067527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:51.067628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:51.086611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:51.087858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:51.153318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 593/1175] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:51.429561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94245455-d61c-4ffd-b763-a6bfa53e705a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:51.515308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:51.531815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94245455-d61c-4ffd-b763-a6bfa53e705a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:51.565390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:51.566023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:51.566303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:51.566576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] PATH_INFO: `/v3/domains/3ed9cd426a52421bbb77108dbc87cb49` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:51.568471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] RBAC: Authorizing `identity:get_domain(domain_id=3ed9cd426a52421bbb77108dbc87cb49)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:51.570540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42560ad-47bd-49eb-b6a5-a73a189e12de None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:51.572406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 583/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Aug 23 23:09:51 2022] GET /identity/v3/domains/3ed9cd426a52421bbb77108dbc87cb49 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:51.577831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:51.597094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:51.676536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c2a46-8781-460d-a8e9-7b727d80d91c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:51.709038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:51.710272 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:51.710472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:51.710730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:51.711360 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:51.712798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9907be-6de0-4a15-974b-fa864466bbe9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:51.732933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 594/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:09:51 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:09:53.668202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5917b-17f2-49cb-87db-0ed549afb34b None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:53.668761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5917b-17f2-49cb-87db-0ed549afb34b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:53.668761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f5917b-17f2-49cb-87db-0ed549afb34b None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:53.670100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 584/1178] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:53.675389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:53.675843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:53.675968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:53.694342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:53.695605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:53.761220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 595/1179] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:54.037045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5917b-17f2-49cb-87db-0ed549afb34b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:54.136934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f5917b-17f2-49cb-87db-0ed549afb34b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:54.170277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:54.170902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:54.171183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:54.171456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:54.181973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:54.186684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:54.187857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:54.188944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:54.191911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 585/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:54.193741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:54.195974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:54.292724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75576c38-b196-439d-9d21-d62882e6bc07 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:54.325355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:54.325960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:54.326239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:54.326511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:54.327176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:54.327485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:54.328893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:54.337386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 596/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:54.343175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:54.359701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:54.442650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3172ac-4733-42db-9e8d-52cd3717c99a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:54.475372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:54.476020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:54.476304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:54.476580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] PATH_INFO: `/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:54.490250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] RBAC: Authorizing `identity:get_user(user_id=f209d5d449d347acb9ef43b2bf9f5ddb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:54.492355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:54.493966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 586/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:54.500026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:54.561261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:54.597970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c61547f-2868-47ee-bc65-cad44c13ea4c None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:54.631841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:54.632442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:54.632727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:54.633006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:54.698400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:54.699881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:54.759805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:54.797869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 597/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:09:54.804491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:54.873715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:54.903984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b7b702-3936-4d87-b1c7-528993293b53 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:54.936780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:54.937410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:54.937694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:54.937969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] PATH_INFO: `/v3/projects/951313ad588e420790abeb8eca544604` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:54.939074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] RBAC: Authorizing `identity:get_project(project_id=951313ad588e420790abeb8eca544604)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:54.940531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c982077-af3a-435e-85c1-5bb8d9676202 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:54.942171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 587/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/projects/951313ad588e420790abeb8eca544604 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:54.948435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:55.047681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c611d0a-766f-40b9-8e31-6471e700c342 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:55.080950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:55.081564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:55.081849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:55.082126 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:55.082851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=951313ad588e420790abeb8eca544604, user.id=f209d5d449d347acb9ef43b2bf9f5ddb) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:55.083162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:55.085371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00344a5d-12d0-49d8-9834-96d2a85a9ae2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:55.090655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 598/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:09:54 2022] GET /identity/v3/role_assignments?user.id=f209d5d449d347acb9ef43b2bf9f5ddb&scope.project.id=951313ad588e420790abeb8eca544604&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:57.000472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede87f45-c50d-4287-acba-6690ef560e7c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.001018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede87f45-c50d-4287-acba-6690ef560e7c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.001018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede87f45-c50d-4287-acba-6690ef560e7c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.002672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 588/1186] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:09:57.008277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.008731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.008829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.026832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:09:57.028057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:09:57.051209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:57.096142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 599/1187] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:09:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:09:57.377031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede87f45-c50d-4287-acba-6690ef560e7c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:57.476955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede87f45-c50d-4287-acba-6690ef560e7c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:57.510090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:57.510713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.510999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.511273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.518592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:57.521894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:09:57.527527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:09:57.528701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:09:57.529735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 589/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:09:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:09:57.534791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:57.633944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec1e795-cf93-4910-b583-74f05d4d331f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:57.667864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:57.668470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.668755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.669032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.669700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:09:57.670008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:57.671373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:57.679368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 600/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:09:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:57.685302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:57.782927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693bb2-8881-40c8-ae29-7284775e4daa None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:57.815088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:57.815702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.816016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.816289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] PATH_INFO: `/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.817384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] RBAC: Authorizing `identity:get_user(user_id=f209d5d449d347acb9ef43b2bf9f5ddb)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:57.819374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:57.820969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 590/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:09:57 2022] GET /identity/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:57.826842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:57.849537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:57.926750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54eb79-34e6-43f6-9846-76a34b70d432 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:57.960321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:57.961115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:57.961396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:57.961674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] PATH_INFO: `/v3/projects/951313ad588e420790abeb8eca544604` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:57.962798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] RBAC: Authorizing `identity:get_project(project_id=951313ad588e420790abeb8eca544604)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:57.964263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7c0e2-8de5-47e2-b444-5b56580b9257 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:57.965896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 601/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:09:57 2022] GET /identity/v3/projects/951313ad588e420790abeb8eca544604 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:09:57.971924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:09:58.036773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:09:58.071410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe62481-e8cc-452a-80b2-260b593ba3ef None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:09:58.103909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:09:58.104571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:58.104858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:58.105138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] PATH_INFO: `/v3/projects/951313ad588e420790abeb8eca544604/users/f209d5d449d347acb9ef43b2bf9f5ddb/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:09:58.107028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] RBAC: Authorizing `identity:create_grant(project_id=951313ad588e420790abeb8eca544604, user_id=f209d5d449d347acb9ef43b2bf9f5ddb, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:09:58.108503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35f54c-b508-4c0d-ac85-2e825c01505b None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:09:58.121709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 591/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:09:57 2022] PUT /identity/v3/projects/951313ad588e420790abeb8eca544604/users/f209d5d449d347acb9ef43b2bf9f5ddb/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:09:59.998181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b126eb-1c30-4a78-851f-e398f1a617db None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:09:59.998720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b126eb-1c30-4a78-851f-e398f1a617db None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:09:59.998720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b126eb-1c30-4a78-851f-e398f1a617db None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:00.000113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 602/1193] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:10:00.005694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:00.006114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:00.006718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:00.025137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:00.026325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:00.092191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 592/1194] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:10:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:10:00.361058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b126eb-1c30-4a78-851f-e398f1a617db None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:00.449663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:00.463218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b126eb-1c30-4a78-851f-e398f1a617db None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:00.496689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:00.497310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:00.497593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:00.497866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:00.508599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:10:00.513302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:00.514423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:10:00.515599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 603/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:10:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:10:00.520423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:00.578474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:00.620265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d37bdb-201f-4118-af8f-2f373e1ada10 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:00.653933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:00.654533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:00.654814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:00.655088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:00.655778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:00.656162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:00.657519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:00.665645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 593/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:10:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:00.671459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:00.777413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cce31-92f0-4137-acd8-003e91d188d0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:00.810006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:00.810633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:00.810916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:00.811192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] PATH_INFO: `/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:00.812337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] RBAC: Authorizing `identity:get_user(user_id=f209d5d449d347acb9ef43b2bf9f5ddb)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:00.813792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:00.815396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 604/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 23 23:10:00 2022] GET /identity/v3/users/f209d5d449d347acb9ef43b2bf9f5ddb => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:00.821967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:00.963973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f4e66-e7e8-4536-a2cf-268127f67565 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:00.984884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:00.999453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:01.000092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:01.000376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:01.000652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:01.069593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:01.071035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:01.174425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 594/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:10:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:10:01.181145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:01.200292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:01.282422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74421141-4936-4e68-91de-6fbeb539f52b None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:01.316949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:01.317572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:01.317847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:01.318119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] PATH_INFO: `/v3/projects/951313ad588e420790abeb8eca544604` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:01.319610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] RBAC: Authorizing `identity:get_project(project_id=951313ad588e420790abeb8eca544604)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:01.322028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2cf41-9cc5-413d-b46d-64c3378d78e6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:01.323646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 605/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 23 23:10:01 2022] GET /identity/v3/projects/951313ad588e420790abeb8eca544604 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:01.329774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:01.351003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:01.427017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec37ea8-b1c7-44fb-b423-495221d8d8bc None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:01.460319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:01.460911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:01.461188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:01.461460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:01.462175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=951313ad588e420790abeb8eca544604, user.id=f209d5d449d347acb9ef43b2bf9f5ddb) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:01.462480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:01.463932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b4b559-b17a-4b06-ba40-503e6de4a230 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:01.469471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 595/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:10:01 2022] GET /identity/v3/role_assignments?user.id=f209d5d449d347acb9ef43b2bf9f5ddb&scope.project.id=951313ad588e420790abeb8eca544604&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:11.312845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=58 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:11.466925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=58 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:57.182085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33b0-74eb-4cb0-b9fc-f876037bc659 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.182710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33b0-74eb-4cb0-b9fc-f876037bc659 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.182710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f33b0-74eb-4cb0-b9fc-f876037bc659 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.184307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 606/1201] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:10:57.189618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.190153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.190153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.210413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:10:57.211628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:10:57.305510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 596/1202] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:10:57.629056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f33b0-74eb-4cb0-b9fc-f876037bc659 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:57.785372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f33b0-74eb-4cb0-b9fc-f876037bc659 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:57.825142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:57.825717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:57.826361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:57.826700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:57.840644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:57.842558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:10:57.860240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:10:57.862061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:10:57.863661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:10:57.863661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:10:57.863661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:10:57.863661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 607/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:10:57.870546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:58.005528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b058c4a-5e5a-49c2-9ca1-ed854546ce12 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:58.046318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:58.053144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.053771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.054127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.054322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.055041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:10:58.055293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:58.056684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7336a5b4-82bf-4a83-8693-07b9260ee035 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:58.069598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 597/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:10:58.075729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:10:58.145069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:10:58.221835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb1b9-72c5-477b-8d45-bbf27514f738 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:10:58.263054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:10:58.263793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:10:58.264194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:10:58.264705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:10:58.265514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:10:58.267193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c0ed13-bbb3-492f-b6fd-6ac5d7119653 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:10:58.293903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 608/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 23 23:10:58 2022] POST /identity/v3/users => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:11:00.343538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c351-1cec-4307-88ff-2c6b2a8c9d16 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.344213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c351-1cec-4307-88ff-2c6b2a8c9d16 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.344213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1c351-1cec-4307-88ff-2c6b2a8c9d16 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.345479 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 598/1206] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:00.351642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.352175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.352279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.371187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:00.372421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:00.456154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 609/1207] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:00.731917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c351-1cec-4307-88ff-2c6b2a8c9d16 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.853291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1c351-1cec-4307-88ff-2c6b2a8c9d16 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:00.892895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:00.893660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:00.893969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:00.894247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:00.911898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:00.916653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:00.917663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:00.918587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 599/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:11:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:00.925492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:00.970280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.046930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d03b50-878d-45ab-9719-c8247c1fcd81 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.086061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.086784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.087138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.087484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.088265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.088646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.090110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.099966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 610/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:11:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.107123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.170621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.229287 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83780c-2f3f-4f80-8866-61f837a53218 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.270288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.271093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.271496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.271861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.284804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.287425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:01.306132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:01.307739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:01.309081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:01.309081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:01.309081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:01.309081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 600/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:01.313927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.429757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.432599 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b0764-2d8b-4dba-a791-df11f5a38d11 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.472645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.473397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.473836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.474844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.475748 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.476162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.477943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.496073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 611/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:01.507003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.635128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ae3619-2dd6-4cfa-bdf3-f67467a40383 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.637056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:01.677010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.678386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.678865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.679285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.688388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.690102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:01.703994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:01.705028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:01.711156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 601/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:01.711926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:01.843988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958ed7-3241-4743-af54-c7c960a5d982 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:01.883046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:01.883046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:01.883046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:01.883046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:01.885657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:01.885657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:01.885657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:01.907924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 612/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:01.909566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.053540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24fccab-c2eb-405b-ad92-7117091a3ae3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.101153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.101854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.102264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.102653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.151844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.207331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.210023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.335997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 602/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 23 23:11:02.337512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.359706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.463906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223286d-bffa-4313-a3b7-a936e4145ab2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.507810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.508158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.508443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.508718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.523331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.525255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:02.544410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:02.547573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:02.548573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:02.548573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:02.548573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:02.548573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 613/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:02.552686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.628381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.676385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdeec9-cbc7-49d2-a1fa-cb38ce7cb885 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.716684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.717453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.717842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.718222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.718969 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:02.719381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.720892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.739112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 603/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:02.741053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:02.831076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:02.868025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c24f5-cc98-4db4-bdfc-bede77abd2b4 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:02.908903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:02.909465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:02.909747 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:02.910019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:02.917256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:02.918711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:02.932102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:02.933254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:02.940465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 614/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:02.941106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:03.071733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2fb2d-57ef-4e30-a397-9d39abe41d69 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:03.099782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:03.116368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:03.117187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.117483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.117810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.118757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:03.119103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:03.120839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eeebdc-11b5-4676-9a87-95a8dc890703 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:03.136288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 604/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:03.142701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:03.269164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8c1af-a1af-4e54-b59f-22f1db9a4de0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:03.305350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:03.316067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:03.316676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:03.316952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:03.317221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:03.318125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=2e7d7805d7c64a6aa65cca2b9b32c94f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:03.318616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:03.321473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16222433-b9b7-4aa4-b932-f712cd08e6bc None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:03.327433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 615/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:03 2022] GET /identity/v3/role_assignments?user.id=2e7d7805d7c64a6aa65cca2b9b32c94f&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:05.485242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312747-31c6-4e41-8ff9-e7e23c6c36fd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.485849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312747-31c6-4e41-8ff9-e7e23c6c36fd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.485940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d312747-31c6-4e41-8ff9-e7e23c6c36fd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.487416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 605/1220] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:05.493590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:05.494020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:05.494735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:05.515169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:05.516505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:05.590455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 616/1221] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 23 23:11:05.881316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d312747-31c6-4e41-8ff9-e7e23c6c36fd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.005737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d312747-31c6-4e41-8ff9-e7e23c6c36fd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.042409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.043051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.043336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.043612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.055890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:06.061555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:06.062768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:06.063644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:06.067928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 606/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:11:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:06.069759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.180298 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206ce6d-66cd-4732-afec-58c379d539e4 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.206505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.221343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.221960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.222242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.222516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.223192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] RBAC: Adding query filter params (name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:06.223500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.225648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.235087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 617/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:06.241865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.290302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.352384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb45a-f361-400f-8b04-93785e60f793 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.388337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.389015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.389301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.389605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.401780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.403372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:06.420583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:06.421612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:06.422525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:06.422525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:06.422525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:06.422525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 607/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:06.428190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.532623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f62e67-7068-47c1-a5ab-f08251229a69 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.574313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.574951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.575210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.575481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.576172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:06.576471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.577840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.590711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 618/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:06.596516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.700606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.708113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd92748-0ab9-4bb7-87f9-35c1688561dd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.745025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.745723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.746026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.746321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.754753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.757116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:06.769894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:06.771637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:06.772665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 608/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:06.777684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:06.832676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:06.898035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42b9a34-00a3-4447-9d9e-1737a6e8bc2e None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:06.937139 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:06.937974 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:06.938270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:06.938645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:06.939666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:06.940194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:06.942079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:06.970939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 619/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:06.973085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.102716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db5be1-88bc-4989-9db1-e9fbb280d59c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.138724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.139444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.139848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.140140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.152085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.153731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:07.168820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:07.169953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:07.171103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:07.171103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:07.171103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:07.171103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 609/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:07.176036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.281653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60d7a4-ed7d-45a9-bcaf-fe5b129722d1 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.284033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.324533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.325149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.325434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.325709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.326365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:07.326669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.328071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.340092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 620/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.345866 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.357521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.459071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547ba03-1ae0-4026-bf2b-b0be90176dad None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.501186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.502057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.502372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.502620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.510257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.512641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:07.526058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:07.527029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:07.527993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:07.532002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 610/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:07.533878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.658722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13b8e1b-a95a-4dcd-b110-0129a6a8e573 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.695613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.696259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.696592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.696803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.697504 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:07.697832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.699340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622190b-574c-4d6e-aab7-b1df8b670445 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.713936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 621/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:07.720256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:07.790766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:07.837288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb00d0-d65c-4b2f-ad89-f10d66e1e9e1 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:07.878864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:07.879561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:07.879877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:07.880434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/2e7d7805d7c64a6aa65cca2b9b32c94f/roles/1a36073c19844c26b5262f438257d932` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:07.901537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=2e7d7805d7c64a6aa65cca2b9b32c94f, role_id=1a36073c19844c26b5262f438257d932)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:07.903050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4063cc3-8ab0-4901-8950-b5019a01d2ec None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:07.919039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 611/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:07 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/2e7d7805d7c64a6aa65cca2b9b32c94f/roles/1a36073c19844c26b5262f438257d932 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:11:10.001031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358604aa-8882-49f2-b26b-66d19e2cd873 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.002248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358604aa-8882-49f2-b26b-66d19e2cd873 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.002248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358604aa-8882-49f2-b26b-66d19e2cd873 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.003510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 622/1233] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:10.009029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.009574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.009574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.030076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:10.031477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:10.106540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 612/1234] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:10.377564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358604aa-8882-49f2-b26b-66d19e2cd873 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.407156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:10.497433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358604aa-8882-49f2-b26b-66d19e2cd873 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:10.535810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:10.536450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.536732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.537129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.550228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:10.558475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:10.559792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:10.560784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 623/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:10.565819 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.625290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:10.684567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f17621-e6e3-4b59-a399-c626aaf6ee34 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:10.719564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:10.720215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.720500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.720775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.721435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] RBAC: Adding query filter params (name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:10.721745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:10.723113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:10.733119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 613/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:10.739194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:10.830889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:10.847531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddef13c-f870-4d79-80b8-96f2127d6658 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:10.888421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:10.889055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:10.889337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:10.889615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:10.901268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:10.902844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:10.919686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:10.920947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:10.922076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:10.922076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:10.922076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:10.922076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 624/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:10.928012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.050992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d363d5-d112-422b-8fc9-8b02bc237851 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.061143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.088169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.088796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.089061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.089361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.089997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:11.090277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.091679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.104823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 614/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:11.110664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.218735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04313edd-10ca-4910-afe1-0b1f8b3e9d7d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.254340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.255500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.255840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.256254 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.259059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.265955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.267407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:11.279924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:11.281241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:11.282454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 625/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:11.288847 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.411205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca17b80-b616-4120-b30e-fd688893d692 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.452317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.453179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.453467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.453814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.454594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:11.454942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.456471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.476510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 615/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:11.482528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.602829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe22615-d86c-40b3-b49e-f8cf3489a7d0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.641067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.641567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.641776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.642039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.709545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.716587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.718047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:11.824529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 626/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:11:11.830438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:11.860413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:11.944520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345759d-0d20-41e3-9ba2-1e395e422546 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:11.982592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:11.983493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:11.984003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:11.984275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:11.995976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:11.997444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:12.014115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:12.015485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:12.016865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:12.016865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:12.016865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:12.016865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 616/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:12.021299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.129193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:12.136638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d37fe-2bfa-4602-a2cd-baf4aa9b252d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.174437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.175422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.175778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.176129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.176922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:12.177231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.178950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.191293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 627/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:12.197758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.295647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:12.321033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22202da4-3222-4d90-8f68-7905be9c3404 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.359977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa269-698e-41cf-a668-b194408342eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.360614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa269-698e-41cf-a668-b194408342eb None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.360899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa269-698e-41cf-a668-b194408342eb None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.361181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744aa269-698e-41cf-a668-b194408342eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.368358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aa269-698e-41cf-a668-b194408342eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.369808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744aa269-698e-41cf-a668-b194408342eb None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-744aa269-698e-41cf-a668-b194408342eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:12.381585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:12.382824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:12.383743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 617/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:12.389096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.509493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d0f1f-cc43-462b-9f64-0705128a8726 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.556995 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.557521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.557853 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.558190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.558821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:12.559162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.560594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947834c-8d54-436d-9916-97113d2369b9 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.577071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 628/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:12.584837 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa269-698e-41cf-a668-b194408342eb None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:12.705451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744aa269-698e-41cf-a668-b194408342eb None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:12.744952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:12.745676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:12.746047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:12.746259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:12.747119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] RBAC: Adding query filter params (role.id=1a36073c19844c26b5262f438257d932, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=2e7d7805d7c64a6aa65cca2b9b32c94f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:12.747433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:12.748909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bda269-2194-4058-a24b-c9245d4612e3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:12.756088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 618/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:12 2022] GET /identity/v3/role_assignments?user.id=2e7d7805d7c64a6aa65cca2b9b32c94f&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=1a36073c19844c26b5262f438257d932 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:14.757846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fde6e-049b-426e-88f9-a83602c64c26 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.758397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fde6e-049b-426e-88f9-a83602c64c26 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.758397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fde6e-049b-426e-88f9-a83602c64c26 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.759730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 629/1247] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:14.765109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:14.765683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:14.765683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:14.772641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:14.788140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:14.789359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:14.865343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 619/1248] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:15.142679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fde6e-049b-426e-88f9-a83602c64c26 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.163468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:15.263700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fde6e-049b-426e-88f9-a83602c64c26 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.300672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.301306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.301594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.302477 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.316044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:15.323257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:15.324502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:15.325456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 630/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:15.330468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.450143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda2391-403e-47f0-b237-1d6c68c28e28 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.486224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:15.492945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.493561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.493840 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.494104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.494771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:15.495072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:15.496458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:15.505933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 620/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:11:15.512160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.604464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:15.632770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c94883-1c3d-490d-b258-9026a870adc3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.672365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.672991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.673265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.673531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.685090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:15.686565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:15.701434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:15.702486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:15.703408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:15.703408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:15.703408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:15.703408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 631/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:15.708493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:15.824235 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f39138-9ef2-48bd-9ee0-ea9979992b10 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:15.866061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:15.866835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:15.867188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:15.867541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:15.868286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:15.868594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:15.869979 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:15.888550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 621/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:15.890051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.018260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21eb300-6d56-4121-a77f-7f3e47a122c8 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.049857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.058957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.059596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.059913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.060192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.069160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.070912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:16.082353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:16.083981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:16.085308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:16.089566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 632/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:16.090699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.155709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.202763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c0edfe-14bf-4744-b1d2-ea1a65db4942 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.239564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.240228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.240508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.240782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.241512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:16.241814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.243234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.261602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 622/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:16.267791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.378946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16084e-9243-4447-a69d-cbdcbe618270 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.422004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.422615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.422891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.423161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.485216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.499942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.501456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.610241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 633/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:11:16.616543 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.726724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff3c0b-d4de-4db9-90ed-8ab316850aca None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.741671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.765178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.765770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.766053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.766328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.778688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.780773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:16.799564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:16.800696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:16.801637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:16.801637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:16.801637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:16.801637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 623/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:16.807045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:16.900496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:16.914694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157a0f3-6757-4126-b6e0-50c00c13af97 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:16.957013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:16.957630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:16.958475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:16.959028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:16.959846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:16.960155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:16.961553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:16.974518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 634/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:16.981894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.113944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd99efcd-60cb-40a4-8072-68820b1bac10 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.155800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.156445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.156682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.156958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.163960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.165389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:17.177309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:17.178447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:17.179376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 624/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:17.184499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.292191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5152df-432a-4bb7-a062-9db48637cfc0 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.330563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.331181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.331458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.331798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.332458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:17.332787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.335073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faea1ae-0102-4e8f-abd0-5f6d6fefa27e None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.348508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 635/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:17.354741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:17.385886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:17.466563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b07345-fce5-4152-b7c4-677eaabfe228 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:17.502875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:17.503500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:17.503831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:17.504214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:17.505533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=2e7d7805d7c64a6aa65cca2b9b32c94f) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:17.505849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:17.507450 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea702-5c2c-49fb-aa86-073184b823de None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:17.514041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 625/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:17 2022] GET /identity/v3/role_assignments?user.id=2e7d7805d7c64a6aa65cca2b9b32c94f&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:19.395898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655bc-c38d-4f1b-8d0f-3a827145a17a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.396601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655bc-c38d-4f1b-8d0f-3a827145a17a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.396601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0655bc-c38d-4f1b-8d0f-3a827145a17a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.397816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 636/1261] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:19.402881 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.403279 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.403445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.422012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:19.423201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:19.489002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 626/1262] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:19.756557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0655bc-c38d-4f1b-8d0f-3a827145a17a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:19.767420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:19.858627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0655bc-c38d-4f1b-8d0f-3a827145a17a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:19.891176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:19.891817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:19.892093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:19.892358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:19.902848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:19.907481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:19.908600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:19.909482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 637/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:19.915290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:19.933393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.033244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43d36e-3696-4b34-9982-bd17db155fd6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.070189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.070797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.071080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.071356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.072055 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:20.072356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.073720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.081539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 627/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:20.087948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.153760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.186468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f1e45-61b4-4f19-86e4-1230bf4d579f None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.220880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.221506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.221787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.222059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.231920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.233366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:20.247453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:20.248615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:20.249901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:20.249901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:20.249901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:20.249901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 638/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:20.254557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.334810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.353640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b39f-9b1f-4fa1-95ff-5e42d95beae7 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.386712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.387314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.387595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.387903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.388544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:20.388850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.390208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.401447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 628/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:20.407070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.505878 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d32554-92e3-4dbc-83a3-534c8af73006 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.525320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.539449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.540101 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.540381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.540653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.547894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.549399 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:20.561871 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:20.562978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:20.564176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 639/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:20.569553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.666249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193bc60-5e1a-4ade-b34e-6ea8084136b3 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.700337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.700941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.701219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.701489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.702208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:20.702515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.703947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.712488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:20.720784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 629/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:20.726992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.825049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc854f3b-8a59-4125-b9e0-0066291c70eb None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:20.857497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:20.858115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:20.858397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:20.858672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:20.869440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:20.870877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:20.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:20.886058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:20.887160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:20.887160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:20.887160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:20.887160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 640/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:20.891851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:20.993354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eeaa47-d3ea-4da4-b1fb-b6a5ded553cd None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.029262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.029870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.030155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.030429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.031073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:21.031376 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.032777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.043728 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 630/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.049395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.081300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.152047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53eb90-06bc-4545-9a0a-b1bf9a1d1f07 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.185800 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.186427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.186711 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.186985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.194097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.195888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:21.206863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:21.207913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:21.208889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 641/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:21.213929 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.272306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.313284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c263808-30dc-4b89-9a6a-b176a056ab7f None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.346682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.347283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.347566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.347868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.348645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:21.348953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.350982 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2093541-0429-4b4e-be58-4141b448e23d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.362560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 631/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:21.368779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:21.463443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:21.472307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921a5cc6-e521-4b08-9083-4476fc8a810d None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:21.505755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:21.506431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:21.506710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:21.506981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] PATH_INFO: `/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/2e7d7805d7c64a6aa65cca2b9b32c94f/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:21.508860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] RBAC: Authorizing `identity:create_grant(project_id=d41dd42fe9954e0c909af16dd06fd264, user_id=2e7d7805d7c64a6aa65cca2b9b32c94f, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:21.510292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831e38e-6145-47b1-b9f4-f5b95c8b6585 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:21.522849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 642/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 23 23:11:21 2022] PUT /identity/v3/projects/d41dd42fe9954e0c909af16dd06fd264/users/2e7d7805d7c64a6aa65cca2b9b32c94f/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:11:23.538555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df7cc-3961-4512-9ad8-03cb485345f1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.539133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df7cc-3961-4512-9ad8-03cb485345f1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.539133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4df7cc-3961-4512-9ad8-03cb485345f1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.540487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 632/1274] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:23.546091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:23.546468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:23.546643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:23.564373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:23.565546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:23.632412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 643/1275] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:23.898978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df7cc-3961-4512-9ad8-03cb485345f1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.009249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4df7cc-3961-4512-9ad8-03cb485345f1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.031831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.050239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.050876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.051156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.051432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.064016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 23 23:11:24.069536 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:24.070677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:24.071910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 633/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 23 23:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:24.076949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.156444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.175013 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f26af-b29a-4a3e-b9ac-8ead6cc73ebf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.208965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.209570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.209854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.210130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.210791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.211095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.212494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.220503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 644/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.226283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.324192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd8f97-fd4e-4d5d-9bc2-3ae0fe931c41 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.356816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.357430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.357715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.357990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.368381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.369822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:24.384943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:24.386099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:24.387244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:24.387244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:24.387244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:24.387244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 634/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:24.391905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.489953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db8ef5-c2bd-4f64-a96e-bf3f46435835 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.523638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.524276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.524558 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.524834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.525482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.525789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.527165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.539930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 645/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.545626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.576846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.647305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd55a-821c-42d5-93cd-1c4b153bcb9a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.680864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.681515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.681797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.682071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.689517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.690956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 23 23:11:24.701999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:24.703098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:24.704290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 635/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:24.709108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.713323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.806822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dd8de-5276-443f-b8a4-fc718ca064d6 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:24.840772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:24.841382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:24.841665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:24.841938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:24.842665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:24.842977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:24.844452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:24.861868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 646/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:24.867884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:24.956384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:24.968089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c82dfa-c4f9-459f-9feb-1caf4e0ff473 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.007619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.008247 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.008532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.008809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.075181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.076586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.162776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.173864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 636/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 23 23:11:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 23 23:11:25.179865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.240617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.279654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a82befc-f8c9-4c6e-b29b-a8fff1dc7c29 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.313765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.314394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.314675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.314948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.324901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.326411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 23 23:11:25.340472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:25.341617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 23 23:11:25.342953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 23 23:11:25.342953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 23 23:11:25.342953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:25.342953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 647/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 23 23:11:25.347220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.444149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192051b-6460-4546-83e1-42c10067eb6e None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.476992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.477580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.477862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.478137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.478777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:25.479081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.480475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.491229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 637/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:25.498220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.597263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43b2d7-db9e-4899-a875-1430c80b8ba2 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.610831 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.630807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.631427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.631703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.632042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.638547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.640000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 23 23:11:25.651384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:25.652482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: ERROR keystone.server.flask.application Aug 23 23:11:25.653603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 648/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:25.658355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.707975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:25.757095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28aba12-f651-4df2-95c8-599b6f7fd47c None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.794768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.795372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.795653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.795958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.796647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:25.796957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.798381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873197d-0f15-447a-ac09-012ca00df313 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.810103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 638/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:25.816191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:25.916593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9aeeb-c70a-4729-88d9-155c336df5e3 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:25.949429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:25.950029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:25.950312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:25.950587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:25.951318 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] RBAC: Adding query filter params (role.id=fa42eaf240474f4086e94c0d56757850, scope.project.id=d41dd42fe9954e0c909af16dd06fd264, user.id=2e7d7805d7c64a6aa65cca2b9b32c94f) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:25.951631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:25.953081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb62b1e-b7af-498a-9fbc-8a5a45f12f8d None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:25.958661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 649/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 23 23:11:25 2022] GET /identity/v3/role_assignments?user.id=2e7d7805d7c64a6aa65cca2b9b32c94f&scope.project.id=d41dd42fe9954e0c909af16dd06fd264&role.id=fa42eaf240474f4086e94c0d56757850 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:27.877180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f142c4-df88-4449-a49b-b7290f8b8d7a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.877704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f142c4-df88-4449-a49b-b7290f8b8d7a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.877794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f142c4-df88-4449-a49b-b7290f8b8d7a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.879104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 639/1288] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:27.885097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:27.885522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:27.885655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:27.903848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:27.905046 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:27.934031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:27.972269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 650/1289] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:28.275363 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f142c4-df88-4449-a49b-b7290f8b8d7a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.374803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f142c4-df88-4449-a49b-b7290f8b8d7a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.385512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:28.408328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.408955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.409237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.409509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.410086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.411462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:28.420418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:28.421610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:28.422495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 640/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:28.427893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.523419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7232924-c5d9-41c4-a273-28635bd534f5 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.560383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.560923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.561205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.561481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.562115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:28.562420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.563814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc311a-fc87-415a-9bc8-dc4e56064c82 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.570925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 651/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:28.574415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:28.672345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9014ade-acad-4f8d-baba-ad8aec92dc53 None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:28.704895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:28.705486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:28.705765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:28.706035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] PATH_INFO: `/v3/services` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:28.706652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:28.706952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:28.708334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e0840-b668-4c0a-9a1c-b279f7fcdcb9 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:28.712686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 641/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:30.591903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32cc4-5f46-454f-88bd-8032f33a59fe None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.592390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32cc4-5f46-454f-88bd-8032f33a59fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.592483 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d32cc4-5f46-454f-88bd-8032f33a59fe None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.593778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 652/1293] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:30.599109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7a24-b55a-4e6a-a480-5bfbd72eb385 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:30.599505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7a24-b55a-4e6a-a480-5bfbd72eb385 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:30.599667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c7a24-b55a-4e6a-a480-5bfbd72eb385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:30.617749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d94c7a24-b55a-4e6a-a480-5bfbd72eb385 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:30.618945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d94c7a24-b55a-4e6a-a480-5bfbd72eb385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:30.649519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:30.685424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 642/1294] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:30.956397 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32cc4-5f46-454f-88bd-8032f33a59fe None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:30.994097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:31.073757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d32cc4-5f46-454f-88bd-8032f33a59fe None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:31.105959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:31.106561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:31.106842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:31.107112 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:31.107779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:31.109155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715339f3-1e53-450d-9162-aa27f87c9364 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:31.124284 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 653/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 23 23:11:30 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:33.061437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f622-a31c-4139-b72b-bf209e43bc70 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.061971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f622-a31c-4139-b72b-bf209e43bc70 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.061971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f622-a31c-4139-b72b-bf209e43bc70 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.063344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 643/1296] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:33.068674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17610-0713-4b58-be9e-91908a523733 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.069075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17610-0713-4b58-be9e-91908a523733 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.069924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d17610-0713-4b58-be9e-91908a523733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.087701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-91d17610-0713-4b58-be9e-91908a523733 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:33.088913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-91d17610-0713-4b58-be9e-91908a523733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:33.160040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 654/1297] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:33 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:33.433744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f622-a31c-4139-b72b-bf209e43bc70 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.535187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f622-a31c-4139-b72b-bf209e43bc70 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.578003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.578641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.578925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.579197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] PATH_INFO: `/v3/services/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.579815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.581190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:33.590006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:33.591219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:33.592540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 644/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:33.597118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17610-0713-4b58-be9e-91908a523733 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.618989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.699438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d17610-0713-4b58-be9e-91908a523733 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.732716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.733320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.733601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.733875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.734551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.734856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.736258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.741955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 655/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.748108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.778960 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:33.847143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115aa9c-9fab-4793-bb38-9a176d9175fe None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:33.880738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:33.881342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:33.881649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:33.882047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:33.882770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] RBAC: Adding query filter params (interface=public, service_id=48314eefb7354d2e927bdf5ee5a66c6c, region_id=RegionOne) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:33.883077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:33.884472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927f0d5c-1162-46bb-b615-52d5a8c07375 None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:33.889346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 645/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/endpoints?service_id=48314eefb7354d2e927bdf5ee5a66c6c&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:33.895166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:33.980027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:34.004927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b57f-654b-4aeb-bbb4-8fdfb88d4380 None admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:34.048019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:34.048736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:34.048905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:34.049172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:34.049777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:34.051142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf1095-c3a4-4a77-af3e-3a9989df43aa None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:34.058422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 656/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 23 23:11:33 2022] GET /identity/v3/services => generated 2191 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:11:35.972576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b0c4-da1f-4a92-967e-995c5e2fb809 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.973152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b0c4-da1f-4a92-967e-995c5e2fb809 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.973152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581b0c4-da1f-4a92-967e-995c5e2fb809 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.974482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 646/1302] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:11:35.980395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:35.980823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:35.980944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:35.999132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:11:36.000346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:11:36.066562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 657/1303] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:11:35 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 23 23:11:36.341959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581b0c4-da1f-4a92-967e-995c5e2fb809 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:36.436818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:36.444709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581b0c4-da1f-4a92-967e-995c5e2fb809 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:36.477469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:36.478093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.478378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.478656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] PATH_INFO: `/v3/services/placement` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.479241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:36.480638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 23 23:11:36.489194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 23 23:11:36.490354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.get_or_create( Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application with Lock( Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self._enter() Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application return self.creator() Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application created_value = creator( Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: ERROR keystone.server.flask.application Aug 23 23:11:36.491388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 647/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 23 23:11:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 23 23:11:36.496564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:36.571163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:36.594640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4db14-cb13-4c3f-9d33-64c1847e3047 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:36.628632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:36.629237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.629516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.629788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] PATH_INFO: `/v3/services` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.630416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:11:36.630721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:36.632863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37290e30-a94e-4b9a-b3f8-2c33f8855c31 None admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:36.637856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 658/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 23 23:11:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:11:36.643708 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:11:36.741445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667e849-f8f2-4b8e-adee-7c1620ac588a None admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:11:36.775388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:11:36.776010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:11:36.776293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:11:36.776568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:11:36.777222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:11:36.778575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949fc0b5-7056-4ac9-b843-97f4dbb2249d None admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:11:36.797903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 648/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:11:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:11:46.635288 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=30 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:11:46.793688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:40.725006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9524-e26d-434d-9f79-6d2253dc1fe2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.725702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9524-e26d-434d-9f79-6d2253dc1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.725702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b9524-e26d-434d-9f79-6d2253dc1fe2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.732590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16feb8-946c-4907-bc55-4cfa525389a3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:40.733069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16feb8-946c-4907-bc55-4cfa525389a3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:40.733153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16feb8-946c-4907-bc55-4cfa525389a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:40.737644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 659/1307] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:40.871766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0d16feb8-946c-4907-bc55-4cfa525389a3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:40.876209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0d16feb8-946c-4907-bc55-4cfa525389a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.077292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 649/1308] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:41.372665 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.373325 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.373841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.375560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 660/1309] 10.222.0.70 () {54 vars in 965 bytes} [Tue Aug 23 23:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:41.382834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87d1b-01e8-4fb7-94e5-6f0efa48c94b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.383150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87d1b-01e8-4fb7-94e5-6f0efa48c94b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.383542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87d1b-01e8-4fb7-94e5-6f0efa48c94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.472307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3ef87d1b-01e8-4fb7-94e5-6f0efa48c94b None None] MFA Rules not processed for user `e8335dd9c12b44f885d60cff8f59e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:41.473894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3ef87d1b-01e8-4fb7-94e5-6f0efa48c94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.500059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.564958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 650/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Tue Aug 23 23:12:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:41.573917 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:41.575733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.700201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f5295-377d-4582-b0b7-52ba76d897b7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:41.796423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:41.797454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:41.797454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:41.797454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:41.799180 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:41.858948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:41.930024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:41.932155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e885c6-5dd7-481a-818e-bde31264c32f service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:41.954620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 661/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:12:44.207303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.207888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.208361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.210893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 651/1312] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:12:44.216443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153069-af6c-4c29-873e-0625bf2e5efa None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.216899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153069-af6c-4c29-873e-0625bf2e5efa None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.217216 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e153069-af6c-4c29-873e-0625bf2e5efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.312083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8e153069-af6c-4c29-873e-0625bf2e5efa None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:44.313398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8e153069-af6c-4c29-873e-0625bf2e5efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:44.421901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 662/1313] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:44.710936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:44.712529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:44.815808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30d1d55-11bf-4572-82bf-8c8c0b24dd00 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:44.885452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:44.888009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:44.888808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:44.889253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:44.889713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:44.891328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:44.998883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:45.000486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb1de-5728-4f17-9c04-e05e6c26e8fe service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:45.018223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 652/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:12:47.221668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:47.222246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:47.222246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:47.223552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 663/1315] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:47.229145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2a07-49bf-4c7d-9886-228c82fea85b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:47.229577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2a07-49bf-4c7d-9886-228c82fea85b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:47.229705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2a07-49bf-4c7d-9886-228c82fea85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:47.299004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4e2e2a07-49bf-4c7d-9886-228c82fea85b None None] MFA Rules not processed for user `c25a5203124948e589990b29322fd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:47.300186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4e2e2a07-49bf-4c7d-9886-228c82fea85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:47.351388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:47.400540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 653/1316] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:47.690073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:47.691651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:47.702134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:47.798499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb29ff5-5a42-40c3-aac5-1db9c2fd2650 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:47.871709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:47.872341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:47.872624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:47.872898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:47.874514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:47.936403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:47.983191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:47.984686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d9c6b-56d5-4b40-81ee-3246b62fbc8b service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:48.003582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 664/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:12:50.462281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2bf6-f9cb-48e6-9f30-276abad0e89a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.462805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2bf6-f9cb-48e6-9f30-276abad0e89a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.462805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff2bf6-f9cb-48e6-9f30-276abad0e89a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.464227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 654/1318] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:50.469388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee5d9-9997-4e80-a538-bda66ca0dedd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.469798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee5d9-9997-4e80-a538-bda66ca0dedd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.469949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dee5d9-9997-4e80-a538-bda66ca0dedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.538730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-58dee5d9-9997-4e80-a538-bda66ca0dedd None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:50.539986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-58dee5d9-9997-4e80-a538-bda66ca0dedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:50.637499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 665/1319] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:50.947702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.948018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.948294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.949638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 655/1320] 10.222.0.70 () {54 vars in 965 bytes} [Tue Aug 23 23:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:50.955481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde5fc-0549-4d42-9ca6-45defafeafa3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:50.955771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde5fc-0549-4d42-9ca6-45defafeafa3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:50.956062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cde5fc-0549-4d42-9ca6-45defafeafa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:50.978937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.039057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c4cde5fc-0549-4d42-9ca6-45defafeafa3 None None] MFA Rules not processed for user `e8335dd9c12b44f885d60cff8f59e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:51.040329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c4cde5fc-0549-4d42-9ca6-45defafeafa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:51.117268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 666/1321] 10.222.0.70 () {58 vars in 1062 bytes} [Tue Aug 23 23:12:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:51.126061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:51.127941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:51.230889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2327ac-ea9c-417c-b4bd-b6e9880a46cd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:51.305983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:51.307003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:51.308251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:51.308546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:51.310802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:51.318073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:51.427081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:51.428685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbdae8-89aa-4678-938e-08d766792faf service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:51.446851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 656/1322] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:12:54.491661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.492221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.492340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.493653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 667/1323] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:54.499044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4a0b-cfb4-4005-9fce-3a2c36b51905 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:54.499440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4a0b-cfb4-4005-9fce-3a2c36b51905 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:54.499634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e4a0b-cfb4-4005-9fce-3a2c36b51905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:54.567775 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bd9e4a0b-cfb4-4005-9fce-3a2c36b51905 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:54.569036 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bd9e4a0b-cfb4-4005-9fce-3a2c36b51905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:54.628047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:54.669542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 657/1324] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:54.958087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:54.960198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:55.065454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe309b-3145-4f0e-9bfe-63a98a282bfb None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:55.078283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:55.143354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:55.143875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:55.144153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:55.144427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:55.146544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:55.259949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:55.261408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e5c5c-6e4c-4d63-b609-5e295d6e0d65 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:55.280574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 668/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:12:57.254738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.255380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.255380 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.256675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 658/1326] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:12:57.261977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7253-20c3-4638-ba17-6cbff3b9a5d0 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.262447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7253-20c3-4638-ba17-6cbff3b9a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.262541 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee7253-20c3-4638-ba17-6cbff3b9a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.312418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:57.332141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9ee7253-20c3-4638-ba17-6cbff3b9a5d0 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:12:57.334463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9ee7253-20c3-4638-ba17-6cbff3b9a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:57.435367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 669/1327] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:12:57.724312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:12:57.725856 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:57.832474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407119-29d7-4e13-b855-244b68b623ca None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:12:57.913538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:12:57.914154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:12:57.914435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:12:57.914709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:12:57.916345 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:12:57.933471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:12:58.030472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:12:58.031965 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe83944-4273-457a-b202-aa7dc7ae6b6d service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:12:58.050844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 659/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:00.023452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.023957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.024052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.025495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 670/1329] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:00.030938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d97a-7757-404a-a5dc-b0115c79328a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.031359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d97a-7757-404a-a5dc-b0115c79328a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.031489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295d97a-7757-404a-a5dc-b0115c79328a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.102448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2295d97a-7757-404a-a5dc-b0115c79328a None None] MFA Rules not processed for user `c25a5203124948e589990b29322fd97b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:00.103674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2295d97a-7757-404a-a5dc-b0115c79328a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:00.169588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.205248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 660/1330] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:00.491638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:00.493265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:00.610904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879f8e0-ab45-48aa-abdc-58322a005c6f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:00.631587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:00.685636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:00.686240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:00.686522 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:00.686796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:00.688414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:00.798443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:00.799859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009c24b-8122-4ca1-9b13-fcbb222e47ff service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:00.818887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 671/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:02.975020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.975564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.975707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:02.977255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 661/1332] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:02.982726 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389199-6c3c-4e25-8b79-f4a97b4b170f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:02.983179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389199-6c3c-4e25-8b79-f4a97b4b170f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:02.983276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9389199-6c3c-4e25-8b79-f4a97b4b170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.047237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.050350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e9389199-6c3c-4e25-8b79-f4a97b4b170f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:03.052732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e9389199-6c3c-4e25-8b79-f4a97b4b170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:03.150241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 672/1333] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:03.435850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:03.437433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:03.546436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e84358-837d-4c9f-8904-03a38e5c39da None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:03.620933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:03.621545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:03.621829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:03.622107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:03.623712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:03.650051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:03.732274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:03.733686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8a683-fd44-4592-97c9-d8e084b856f6 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:03.752567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 662/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:05.704467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.705026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.705026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.706410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 673/1335] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:05.712473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d536-a022-4de3-9497-0d06db9f5930 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:05.712857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d536-a022-4de3-9497-0d06db9f5930 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:05.713039 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52d536-a022-4de3-9497-0d06db9f5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:05.779602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ce52d536-a022-4de3-9497-0d06db9f5930 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:05.780867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ce52d536-a022-4de3-9497-0d06db9f5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:05.855023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:05.878715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 663/1336] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:06.165722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:06.167256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:06.275416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77738e40-9be9-47a9-9f5f-6a975f20f773 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:06.303842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:06.349744 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:06.350532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:06.350639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:06.350884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:06.352745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:06.461579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:06.462949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9a2de-878b-43b4-9862-c0e6361ab5e1 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:06.481218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 674/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:08.726835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.727362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.727362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.728682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 664/1338] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:08.733901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b77e-8196-41ff-b819-06cacf1d4b32 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:08.734332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b77e-8196-41ff-b819-06cacf1d4b32 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:08.734445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5267b77e-8196-41ff-b819-06cacf1d4b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:08.799798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5267b77e-8196-41ff-b819-06cacf1d4b32 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:08.801018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5267b77e-8196-41ff-b819-06cacf1d4b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:08.810024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:08.900556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 675/1339] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:09.187977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:09.189625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:09.293667 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d935bc-a198-42b1-b309-e1a113900b5c None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:09.367685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:09.368321 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:09.368601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:09.368872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:09.370456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:09.404886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:09.478241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:09.479588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407391c0-5c66-46bb-865b-cebf71c6a707 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:09.497234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 665/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:13.538077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.538668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.538668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.540063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 676/1341] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:13.545763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d7c59-b99f-4272-9ff0-810ac9922a1e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:13.546244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d7c59-b99f-4272-9ff0-810ac9922a1e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:13.546963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d7c59-b99f-4272-9ff0-810ac9922a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:13.621861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1f8d7c59-b99f-4272-9ff0-810ac9922a1e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:13.623085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1f8d7c59-b99f-4272-9ff0-810ac9922a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:13.711595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:13.724062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 666/1342] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:14.009718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:14.011302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:14.120021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6fe099-83a9-4fd7-af27-11aca8c3dd60 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:14.158983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:14.196231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:14.196845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:14.197127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:14.197401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:14.198991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:14.310213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:14.311582 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5f98be-33bf-477a-b54f-47adb3eeeab0 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:14.330032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 677/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:16.889213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.889796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.889796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.891096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 667/1344] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:16.897070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab1f4e-576a-44fd-89ea-9c131b2d963e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:16.897487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab1f4e-576a-44fd-89ea-9c131b2d963e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:16.897623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab1f4e-576a-44fd-89ea-9c131b2d963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:16.967702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-e5ab1f4e-576a-44fd-89ea-9c131b2d963e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:16.968950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-e5ab1f4e-576a-44fd-89ea-9c131b2d963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:16.988663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.069802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 678/1345] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:17.365435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:17.366988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:17.471403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68434b35-cce7-495c-a5b2-b35460e89ee6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:17.550804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:17.551968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:17.552305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:17.552530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:17.554188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:17.601304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:17.672535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:17.673899 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7a372-6452-4147-ad2f-ddaf3f89c046 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:17.693097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 668/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:21.684243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.684815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.685514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.686925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 679/1347] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:21.695205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c635f-5949-4034-b29a-70e2d7a5b03d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:21.695205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c635f-5949-4034-b29a-70e2d7a5b03d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:21.696062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5c635f-5949-4034-b29a-70e2d7a5b03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:21.766802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ea5c635f-5949-4034-b29a-70e2d7a5b03d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:21.768105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ea5c635f-5949-4034-b29a-70e2d7a5b03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:21.870505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:21.873612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 669/1348] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:22.169575 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:22.171120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:22.280934 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbcad24-5aa8-4668-8d46-49579e55925e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:22.330146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:22.358113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:22.358727 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:22.359009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:22.359282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:22.361093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:22.483715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:22.485204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbe0dc-3528-4701-9e87-1cd2bb403684 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:22.505650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 680/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:13:27.536994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab24af-f4ca-4e9c-989c-d76e472a6f6c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.537518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab24af-f4ca-4e9c-989c-d76e472a6f6c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.537518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab24af-f4ca-4e9c-989c-d76e472a6f6c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.539169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 670/1350] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:27.544437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286656-ddb3-43cf-aa80-72176c52c3d7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:27.544851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286656-ddb3-43cf-aa80-72176c52c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:27.545200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85286656-ddb3-43cf-aa80-72176c52c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:27.652327 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-85286656-ddb3-43cf-aa80-72176c52c3d7 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:27.654096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-85286656-ddb3-43cf-aa80-72176c52c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:27.678062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:27.813497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 681/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:13:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:32.058053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44046ac-f2fe-4d48-93c0-1fa1ecba2715 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.058613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44046ac-f2fe-4d48-93c0-1fa1ecba2715 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.058613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44046ac-f2fe-4d48-93c0-1fa1ecba2715 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.062085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 671/1352] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:32.065722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa0a4-aa4f-418d-bead-e00d0e3d7e61 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:32.066157 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa0a4-aa4f-418d-bead-e00d0e3d7e61 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:32.066267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa0a4-aa4f-418d-bead-e00d0e3d7e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:32.148834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-75afa0a4-aa4f-418d-bead-e00d0e3d7e61 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:32.150059 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75afa0a4-aa4f-418d-bead-e00d0e3d7e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:32.224948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:32.267963 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 682/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:13:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:33.657353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236897c1-53cc-4eb2-9950-8ca811ffc046 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.657933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236897c1-53cc-4eb2-9950-8ca811ffc046 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.657933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236897c1-53cc-4eb2-9950-8ca811ffc046 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.659260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 672/1354] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:33.665191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60edc-1099-453f-9f38-8394707637ee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:33.666113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60edc-1099-453f-9f38-8394707637ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:33.666393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab60edc-1099-453f-9f38-8394707637ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:33.745627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1ab60edc-1099-453f-9f38-8394707637ee None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:33.746862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1ab60edc-1099-453f-9f38-8394707637ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:33.855129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 683/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:13:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:37.213583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fa27-9ae0-459c-a5b6-09cf32b4ab52 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.214168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fa27-9ae0-459c-a5b6-09cf32b4ab52 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.214168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27fa27-9ae0-459c-a5b6-09cf32b4ab52 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.215464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 673/1356] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:37.220956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdd77-d609-4f4d-8ce9-6fcf18f9e15f None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.221404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdd77-d609-4f4d-8ce9-6fcf18f9e15f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.221499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cdd77-d609-4f4d-8ce9-6fcf18f9e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.267299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:37.300326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-055cdd77-d609-4f4d-8ce9-6fcf18f9e15f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:37.301643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-055cdd77-d609-4f4d-8ce9-6fcf18f9e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:37.432092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 684/1357] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:37.751997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.752880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.753612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.755908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 674/1358] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 23 23:13:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:37.763977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea1a7-f899-4e96-b7eb-a416a3c6a241 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:37.764312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea1a7-f899-4e96-b7eb-a416a3c6a241 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:37.764587 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaea1a7-f899-4e96-b7eb-a416a3c6a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:37.866633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-fdaea1a7-f899-4e96-b7eb-a416a3c6a241 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:37.867989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fdaea1a7-f899-4e96-b7eb-a416a3c6a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:37.924631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:38.000217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 685/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 23 23:13:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:38.019269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:38.021885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:38.175292 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0352dfc-64f5-4bd2-beda-c3cfa9509d23 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:38.253583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:38.296588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:38.297113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:38.297391 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:38.297669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:38.299251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:38.396688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:38.398324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b05fe5e-fd1c-432f-b30f-9301747a0edf service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:38.417705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 675/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:13:40.564792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.565237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.565355 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.572846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0976f-ef39-461b-90e9-db48bd881b8a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:40.572846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0976f-ef39-461b-90e9-db48bd881b8a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:40.573396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a0976f-ef39-461b-90e9-db48bd881b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:40.575959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 686/1361] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:40.647454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e6a0976f-ef39-461b-90e9-db48bd881b8a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:40.648649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e6a0976f-ef39-461b-90e9-db48bd881b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:40.690962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:40.759071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 676/1362] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:41.061273 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:41.062809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:41.225244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983cb05-1cb7-430f-ad48-81e387886a0f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:41.235893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:41.355010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:41.355951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:41.356392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:41.356823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:41.358807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:41.469570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:41.471390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c803161-17ea-4665-9187-57b610e835ae service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:41.492618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 687/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:43.789461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274ee7-d8bf-4c25-8399-35ea21c66ed6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.799429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274ee7-d8bf-4c25-8399-35ea21c66ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.799429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf274ee7-d8bf-4c25-8399-35ea21c66ed6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.799429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 677/1364] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:43.799863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835176-1fd9-4e33-82e4-abf8f028c32a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:43.799863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835176-1fd9-4e33-82e4-abf8f028c32a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:43.799863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1835176-1fd9-4e33-82e4-abf8f028c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:43.815559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:43.871911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-b1835176-1fd9-4e33-82e4-abf8f028c32a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:43.873443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b1835176-1fd9-4e33-82e4-abf8f028c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:43.983811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 688/1365] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:44.281042 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.281338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.281777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.283385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 678/1366] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 23 23:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:44.290135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cf18-fb7a-41c5-ac77-95a08956d773 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.290518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cf18-fb7a-41c5-ac77-95a08956d773 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.290869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f5cf18-fb7a-41c5-ac77-95a08956d773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.372861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-73f5cf18-fb7a-41c5-ac77-95a08956d773 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:44.374761 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73f5cf18-fb7a-41c5-ac77-95a08956d773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:44.413429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:44.502474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 689/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 23 23:13:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:44.511031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:44.512611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:44.682300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968fa14-2375-4855-8537-53d98dc37f8f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:44.704326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:44.809049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:44.809773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:44.810017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:44.810218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:44.811826 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:44.912720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:44.914374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f9904-a6a5-47f9-815c-a9fee9f37628 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:44.936149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 679/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:45.557733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078a1-29f6-4a60-91e9-c429d94ce124 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.558289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078a1-29f6-4a60-91e9-c429d94ce124 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.558289 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f078a1-29f6-4a60-91e9-c429d94ce124 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.559689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 690/1369] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:45.565423 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ca8-2154-458e-97a7-037da7876bca None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:45.565825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ca8-2154-458e-97a7-037da7876bca None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:45.566912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8ca8-2154-458e-97a7-037da7876bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:45.605225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:45.643654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c3fc8ca8-2154-458e-97a7-037da7876bca None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:45.645731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c3fc8ca8-2154-458e-97a7-037da7876bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:45.749612 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 680/1370] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:46.346018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.346018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.346018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.349816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 691/1371] 10.222.0.70 () {54 vars in 964 bytes} [Tue Aug 23 23:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:46.352950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00f89-715d-4ed0-ba63-03a1cd3b64fc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.353471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00f89-715d-4ed0-ba63-03a1cd3b64fc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.353633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da00f89-715d-4ed0-ba63-03a1cd3b64fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.439533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3da00f89-715d-4ed0-ba63-03a1cd3b64fc None None] MFA Rules not processed for user `bea41ec6a516482e89cbcd12344250e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:46.441435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3da00f89-715d-4ed0-ba63-03a1cd3b64fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:46.490949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.526444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 681/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Aug 23 23:13:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:46.534445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:46.536406 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:46.657712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b50625-9a31-414c-b6ca-26d34f815720 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:46.705120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:46.753392 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea41ec6a516482e89cbcd12344250e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:46.753938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.754230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.754560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.756218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:46.879434 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:46.880914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e6463-3b9d-4c85-99a9-ffd4faf9f91b service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:46.904256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 692/1373] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:46.974990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.975447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.975590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:46.977229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 682/1374] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:46.982429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cece4-0c5d-4154-a65e-ff7106516cef None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:46.982714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cece4-0c5d-4154-a65e-ff7106516cef None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:46.982849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cece4-0c5d-4154-a65e-ff7106516cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.076433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-227cece4-0c5d-4154-a65e-ff7106516cef None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:47.077653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-227cece4-0c5d-4154-a65e-ff7106516cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:47.098458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:47.177130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 693/1375] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:47.470125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:47.471841 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:47.629208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76310e9-9c75-4c4f-8da1-6031c1003355 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:47.688469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:47.754096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:47.754623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:47.754905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:47.755184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:47.756883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:47.849515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:47.851113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13503739-9886-46ec-b35c-10a8fb652ac9 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:47.869181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 683/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:49.856877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:49.857381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:49.857501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:49.858802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 694/1377] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:49.864173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bf3d-3a06-40f4-9958-8d93e2a2a3c6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:49.864610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bf3d-3a06-40f4-9958-8d93e2a2a3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:49.864743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2bf3d-3a06-40f4-9958-8d93e2a2a3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:49.940219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1de2bf3d-3a06-40f4-9958-8d93e2a2a3c6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:49.942032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1de2bf3d-3a06-40f4-9958-8d93e2a2a3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:49.948563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:50.075734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 684/1378] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:50.387132 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:50.393973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:50.596171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb644123-0bc6-46a6-98d4-835a9766be6e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:50.600700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:50.849433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:50.850040 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:50.850322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:50.850594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:50.852229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:50.948891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:50.950555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e15e8-f1ce-4d23-bb45-4950b0493f18 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:50.969889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 695/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:52.971014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:52.971560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:52.971560 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:52.973199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 685/1380] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:52.978448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869d8-897e-4079-8991-f83b595f3ce3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:52.978876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869d8-897e-4079-8991-f83b595f3ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:52.978981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3869d8-897e-4079-8991-f83b595f3ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:52.991261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:53.049552 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-be3869d8-897e-4079-8991-f83b595f3ce3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:53.051061 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-be3869d8-897e-4079-8991-f83b595f3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:53.172398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 696/1381] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:53.478677 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:53.480482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:53.652892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:53.664999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023801a1-f953-4eff-8477-3a6725ca02e2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:53.799944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:53.801186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:53.801476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:53.801749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:53.803469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:53.917156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:53.918909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b4f02-c919-442e-954e-d9617a1d0a0c service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:53.930141 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:53.940092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 686/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:55.910502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:55.911248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:55.911248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:55.912438 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 697/1383] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:55.920675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d340-87dd-4b13-90ac-faf38678b765 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:55.921276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d340-87dd-4b13-90ac-faf38678b765 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:55.921276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d37d340-87dd-4b13-90ac-faf38678b765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:55.992603 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0d37d340-87dd-4b13-90ac-faf38678b765 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:55.993832 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0d37d340-87dd-4b13-90ac-faf38678b765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:56.098118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 687/1384] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:56.400293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:56.402129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:56.491183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:56.559029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c32be1-9dc7-4b73-9361-df10813d6571 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:13:56.676545 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:13:56.676964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:56.677352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:56.677628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:56.679294 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:56.730971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:13:56.773127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:13:56.774730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c354c34-6bff-4b6a-b006-1889f3f14712 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:13:56.795958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 698/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:13:59.345811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:59.346366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:59.346463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:59.348531 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 688/1386] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:13:59.354349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ada08-655f-4fe9-95d8-cf3010a23570 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:13:59.354937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ada08-655f-4fe9-95d8-cf3010a23570 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:13:59.354937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ada08-655f-4fe9-95d8-cf3010a23570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:13:59.422690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c48ada08-655f-4fe9-95d8-cf3010a23570 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:13:59.423952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c48ada08-655f-4fe9-95d8-cf3010a23570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:13:59.534413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 699/1387] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:13:59.922452 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:13:59.924018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:00.009283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:00.093266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59c3fbb-b321-4035-a597-42ed11c1bd90 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:00.229152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:00.229696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:00.230303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:00.230303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:00.231886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:00.274255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:00.327634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:00.329346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa71aab3-0651-41e6-b4f4-9749d6f377ae service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:00.349107 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 689/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:02.121050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbca3f-eb6c-44f1-a5a0-7ead36182e99 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.121567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbca3f-eb6c-44f1-a5a0-7ead36182e99 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.121567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dbca3f-eb6c-44f1-a5a0-7ead36182e99 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.122892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 700/1389] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:02.129063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf2e0-63b6-4a50-9cc2-c0eea81cd17d None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.129644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf2e0-63b6-4a50-9cc2-c0eea81cd17d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.129743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cf2e0-63b6-4a50-9cc2-c0eea81cd17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.209790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b58cf2e0-63b6-4a50-9cc2-c0eea81cd17d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:02.210989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b58cf2e0-63b6-4a50-9cc2-c0eea81cd17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:02.288563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9695-6231-47bc-a59c-6279dc6aa493 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.288962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9695-6231-47bc-a59c-6279dc6aa493 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.289244 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d9695-6231-47bc-a59c-6279dc6aa493 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.290600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 701/1390] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:14:02.296848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b708f-57d4-4a73-862d-9de494714cb5 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.297133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b708f-57d4-4a73-862d-9de494714cb5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.297404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b708f-57d4-4a73-862d-9de494714cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.313246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 690/1391] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:02.339000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:02.371412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-527b708f-57d4-4a73-862d-9de494714cb5 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:02.372584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-527b708f-57d4-4a73-862d-9de494714cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:02.473997 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 702/1392] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:14:02.623285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.623664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.624032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.625401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 691/1393] 10.222.0.70 () {54 vars in 967 bytes} [Tue Aug 23 23:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:02.631900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.632267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.632627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.710245 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] MFA Rules not processed for user `b95d02dc83464209b536460b970d024b`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:02.711463 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:02.762050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:02.769858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:02.771897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:02.786199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:02.792768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 703/1394] 10.222.0.70 () {58 vars in 1064 bytes} [Tue Aug 23 23:14:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:02.800937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:02.809052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953328c-b6d6-40a2-89b7-474b8b38f89b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:02.884390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95d02dc83464209b536460b970d024b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:02.884915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:02.885197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:02.885473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:02.887090 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:02.923461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981d749-8ec6-4520-a95a-eb49c957d9ee None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:03.000333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:03.002474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e06ec-e0f3-42ba-88e2-6e31e89d31ec service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:03.012300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:03.018351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:03.024131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 704/1395] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:14:03.041097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:03.041712 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:03.042000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:03.042277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:03.043932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:03.135478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:03.137027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895a465b-2bc2-4dcd-8e1e-3b2cab7c29ce service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:03.155563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 692/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:14:03.789085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e00ca-f542-451d-bf03-0977a0bec8a9 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:03.789621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e00ca-f542-451d-bf03-0977a0bec8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:03.789621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e00ca-f542-451d-bf03-0977a0bec8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:03.860695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ec9e00ca-f542-451d-bf03-0977a0bec8a9 None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:03.861918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ec9e00ca-f542-451d-bf03-0977a0bec8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:03.953600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 705/1397] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:14:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:04.002338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:04.002632 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:04.002915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:04.005027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 693/1398] 10.222.0.70 () {54 vars in 943 bytes} [Tue Aug 23 23:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:04.011263 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c958d5-813c-4653-80d6-4598124fd244 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:04.011556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c958d5-813c-4653-80d6-4598124fd244 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:04.011855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c958d5-813c-4653-80d6-4598124fd244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:04.087447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-52c958d5-813c-4653-80d6-4598124fd244 None None] MFA Rules not processed for user `528934c45fb140dea3dc59f2056fcd5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:04.088691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-52c958d5-813c-4653-80d6-4598124fd244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:04.118000 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:04.202184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 706/1399] 10.222.0.70 () {58 vars in 1040 bytes} [Tue Aug 23 23:14:04 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:14:04.212023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:04.213519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:04.312937 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:04.358838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5a76a-3d19-48a6-91bb-afeae997a29d None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:04.464409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:04.465045 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:04.465332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:04.465607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:04.467251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:04.550729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:04.552818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b825d38-3ea9-46a0-93e5-ccb0ab3ac18b service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:04.556521 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:04.562301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 694/1400] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:14:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:14:05.186303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:05.186891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:05.186891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:05.188579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 707/1401] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:14:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:05.195218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b5df-a7ed-4b75-a00e-f9074ae6c525 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:05.195508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b5df-a7ed-4b75-a00e-f9074ae6c525 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:05.195825 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9b5df-a7ed-4b75-a00e-f9074ae6c525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:05.272886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-0fe9b5df-a7ed-4b75-a00e-f9074ae6c525 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:05.274220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-0fe9b5df-a7ed-4b75-a00e-f9074ae6c525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:05.382476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 695/1402] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:05.681834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:05.683548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:05.868781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcd664b-6c1c-46a9-b96e-25f3c02bc806 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:05.871666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:06.009827 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:06.010455 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:06.010746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:06.011024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:06.012719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:06.115027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:06.117035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ffc69-8e88-41ea-ad3d-52e2b1bf9b24 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:06.139022 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 708/1403] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:08.210704 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeab9-4503-4660-a158-812856c3047e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:08.211317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeab9-4503-4660-a158-812856c3047e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:08.211317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853eeab9-4503-4660-a158-812856c3047e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:08.212658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 696/1404] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:08.217894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee081f-466c-42f6-8e31-a0ac23ff8eab None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:08.218390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee081f-466c-42f6-8e31-a0ac23ff8eab None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:08.218578 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee081f-466c-42f6-8e31-a0ac23ff8eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:08.232542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:08.301563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-19ee081f-466c-42f6-8e31-a0ac23ff8eab None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:08.303211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-19ee081f-466c-42f6-8e31-a0ac23ff8eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:08.424516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 709/1405] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:14:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:08.719616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eeab9-4503-4660-a158-812856c3047e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:08.721172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-853eeab9-4503-4660-a158-812856c3047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:08.818971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:08.893184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853eeab9-4503-4660-a158-812856c3047e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:09.021165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:09.021774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:09.022068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:09.022324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:09.024195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:09.069475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:09.125494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:09.127669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbda98-9883-47b8-a466-b2838544eed5 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:09.148441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 697/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:11.151421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:11.152048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:11.152048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:11.153384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 710/1407] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:11.158601 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3311-f1e6-44c8-a169-fd772d347c8e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:11.159024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3311-f1e6-44c8-a169-fd772d347c8e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:11.159172 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4d3311-f1e6-44c8-a169-fd772d347c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:11.236223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8d4d3311-f1e6-44c8-a169-fd772d347c8e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:11.237493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8d4d3311-f1e6-44c8-a169-fd772d347c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:11.352471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 698/1408] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:14:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:11.649127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:11.650649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:11.744882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:11.823669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dacd64-cd6f-4993-b468-66fa4ae69ba1 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:11.959584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:11.960149 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:11.960447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:11.960713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:11.962361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:12.023118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:12.071362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:12.073114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3fc056-d12e-4bfc-bb1d-3f6aff485953 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:12.094384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 711/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:21.350702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=93 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:22.092118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=24 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:27.168019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace632b-7907-4818-b0f8-aa6cdee1459a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:27.168605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace632b-7907-4818-b0f8-aa6cdee1459a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:27.168605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace632b-7907-4818-b0f8-aa6cdee1459a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:27.169912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 699/1410] 10.222.0.70 () {54 vars in 918 bytes} [Tue Aug 23 23:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:27.175485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5fd7-a6f6-4ca3-a0e5-15dfa0d76c6d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:27.176177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5fd7-a6f6-4ca3-a0e5-15dfa0d76c6d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:27.176365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a5fd7-a6f6-4ca3-a0e5-15dfa0d76c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:27.250532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d67a5fd7-a6f6-4ca3-a0e5-15dfa0d76c6d None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:27.251771 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d67a5fd7-a6f6-4ca3-a0e5-15dfa0d76c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:27.361362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 712/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Aug 23 23:14:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:27.375812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283b8d-4d73-4d53-b5fe-5dc0299c8ce5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:27.376128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283b8d-4d73-4d53-b5fe-5dc0299c8ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:27.376410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a283b8d-4d73-4d53-b5fe-5dc0299c8ce5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:27.378818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 700/1412] 10.222.0.70 () {54 vars in 918 bytes} [Tue Aug 23 23:14:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:27.383661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633854-9268-4a16-b03c-c08f295c46cd None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:27.383976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633854-9268-4a16-b03c-c08f295c46cd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:27.384249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc633854-9268-4a16-b03c-c08f295c46cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:27.459275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:27.461944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-cc633854-9268-4a16-b03c-c08f295c46cd None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:27.463687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc633854-9268-4a16-b03c-c08f295c46cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:27.582447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 713/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Aug 23 23:14:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:29.986303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:29.986921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:29.986921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:29.988465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:29.993906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e686-3462-4bd4-b0b5-0f4b28ec606c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:29.994320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e686-3462-4bd4-b0b5-0f4b28ec606c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:29.994460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a61e686-3462-4bd4-b0b5-0f4b28ec606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:30.061908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4a61e686-3462-4bd4-b0b5-0f4b28ec606c None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:30.063119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4a61e686-3462-4bd4-b0b5-0f4b28ec606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:30.117589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:30.160086 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:30.448147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:30.449729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:30.598551 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614c8288-41f3-44ab-9e55-0479e5ab108e None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:30.670941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:30.711439 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:30.712077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:30.712361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:30.712633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:30.714236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:30.804511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:30.806131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f04150-8c89-4a40-94ac-90e967bf88a1 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:30.824346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 702/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:31.724457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:31.725023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:31.725023 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:31.727164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:31.732162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8f13-89fb-42e5-8512-adaf28be1579 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:31.732602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8f13-89fb-42e5-8512-adaf28be1579 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:31.732722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d8f13-89fb-42e5-8512-adaf28be1579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:31.807720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-598d8f13-89fb-42e5-8512-adaf28be1579 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:31.808961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-598d8f13-89fb-42e5-8512-adaf28be1579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:31.836297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:31.906069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:14:32.056588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:32.058198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:32.205870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae41731-ca2b-481a-bf73-c9db1ceb1f3f None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:32.248679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:32.322077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:32.322691 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:32.322976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:32.323255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:32.324910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:32.415188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:32.416838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922af5cc-7482-4819-86a9-5f6bbfe6ae5a service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:32.435473 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 716/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:33.327630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:33.328308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:33.328308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:33.329631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:33.334759 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00c02-d49a-4421-9960-1c4eb2f44d36 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:33.335199 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00c02-d49a-4421-9960-1c4eb2f44d36 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:33.335297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d00c02-d49a-4421-9960-1c4eb2f44d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:33.392051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:33.419258 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-09d00c02-d49a-4421-9960-1c4eb2f44d36 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:33.420534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-09d00c02-d49a-4421-9960-1c4eb2f44d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:33.515617 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:33.668642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:33.670710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:33.824731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f6a28-b757-4638-b726-71c879b1a5c5 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:33.836951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:33.937904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:33.938425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:33.938715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:33.938991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:33.941255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:34.031630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:34.033270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268df7d0-c3a2-4357-ba59-66206dbcd7fd service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:34.052068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 705/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:34.925836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:34.926408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:34.926408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:34.927743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:34.932657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0d2-b075-4c9b-8b9b-c723f6a61bd4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:34.933066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0d2-b075-4c9b-8b9b-c723f6a61bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:34.933219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cad0d2-b075-4c9b-8b9b-c723f6a61bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:34.953387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:35.009955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-93cad0d2-b075-4c9b-8b9b-c723f6a61bd4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:35.011161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-93cad0d2-b075-4c9b-8b9b-c723f6a61bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:35.107308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:35.257190 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:35.258643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:35.370682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:35.407580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20858f-5f86-4a73-a3f8-3aabfe75be29 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:35.521163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:35.521689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:35.521970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:35.522242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:35.523901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:35.602223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:35.617187 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:35.618803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf21c99c-99bf-42e3-bb70-c06ee40215f9 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:35.637816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 719/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:36.509735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:36.510264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:36.510264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:36.511569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:36.516624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322e28-a55a-4879-972b-14a94bd914d8 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:36.517076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322e28-a55a-4879-972b-14a94bd914d8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:36.517176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26322e28-a55a-4879-972b-14a94bd914d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:36.595900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-26322e28-a55a-4879-972b-14a94bd914d8 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:36.597857 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-26322e28-a55a-4879-972b-14a94bd914d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:36.699173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:36.853212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:36.855034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:36.937945 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:37.000063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283b7e2b-8089-4178-abe5-9f099b841d8f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:37.111503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:37.112099 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:37.112393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:37.112668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:37.114304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:37.162620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:37.205116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:37.207427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1de15-82e1-4203-9849-9c0c61a1e122 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:37.225396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 708/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:38.050421 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:38.051097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:38.051097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:38.052408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:38.057614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016705-d0e3-462b-9214-5c9677ba048f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:38.058057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016705-d0e3-462b-9214-5c9677ba048f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:38.058175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8016705-d0e3-462b-9214-5c9677ba048f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:38.133508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-f8016705-d0e3-462b-9214-5c9677ba048f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:38.134720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8016705-d0e3-462b-9214-5c9677ba048f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:38.241231 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:38.393919 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:38.395606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:38.445718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:38.548166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a464fa7-2a6b-41e1-accb-1660db0da243 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:38.665387 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:38.665921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:38.666202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:38.666476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:38.668118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:38.676176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:38.759615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:38.761271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22c7d1-dfdf-4672-a77c-4747da705640 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:38.779939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 722/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:39.591131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:39.591583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:39.591687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:39.593077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:39.598763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da2a8-c0a7-4922-b199-af4dfac2976b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:39.599197 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da2a8-c0a7-4922-b199-af4dfac2976b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:39.599304 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86da2a8-c0a7-4922-b199-af4dfac2976b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:39.678927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a86da2a8-c0a7-4922-b199-af4dfac2976b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:39.680174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a86da2a8-c0a7-4922-b199-af4dfac2976b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:39.746350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:39.776147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:39.935955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:39.937491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:39.955546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:40.082620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cea63-4775-459f-999e-aa89a58a67bf None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:40.169079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:40.196083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:40.196701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:40.196986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:40.197262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:40.198872 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:40.295777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:40.297403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49f1b8-bbc9-4bbc-9433-a884475df5df service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:40.318931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 711/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:41.126676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:41.127238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:41.127238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:41.129053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:41.134048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3476c8-feac-4b53-961e-caea6987acef None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:41.134500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3476c8-feac-4b53-961e-caea6987acef None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:41.134609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3476c8-feac-4b53-961e-caea6987acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:41.210571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-bf3476c8-feac-4b53-961e-caea6987acef None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:41.212565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-bf3476c8-feac-4b53-961e-caea6987acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:41.258721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:41.313838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:41.464868 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:41.466411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:41.614052 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc689878-d9ce-4723-9534-cd8b6204af98 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:41.670720 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:41.730347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:41.730955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:41.731234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:41.731506 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:41.733123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:41.821605 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:41.823118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a9964-70ab-44cb-be16-72064bf0ce43 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:41.841589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 725/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:42.642928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:42.643715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:42.643715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:42.645019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:42.649879 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4249d9-413f-4872-b49d-712508273650 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:42.650305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4249d9-413f-4872-b49d-712508273650 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:42.650447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4249d9-413f-4872-b49d-712508273650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:42.733233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-af4249d9-413f-4872-b49d-712508273650 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:42.734458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-af4249d9-413f-4872-b49d-712508273650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:42.736491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:42.834077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:42.982933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:42.984486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:43.141732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f5c19-f438-4577-8ff7-954fe36d8bfe None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:43.167585 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:43.258777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:43.259302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:43.259590 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:43.259898 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:43.261538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:43.356469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:43.358095 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a5c51-58e3-4e4a-ae2a-12499dbcf28e service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:43.376109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 714/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:45.215985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:45.216579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:45.216579 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:45.217883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:45.224026 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b9ac-4f7a-49db-84ec-3fc6c9dbb6cc None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:45.224489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b9ac-4f7a-49db-84ec-3fc6c9dbb6cc None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:45.224608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672b9ac-4f7a-49db-84ec-3fc6c9dbb6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:45.264967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:45.290978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b672b9ac-4f7a-49db-84ec-3fc6c9dbb6cc None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:45.292230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b672b9ac-4f7a-49db-84ec-3fc6c9dbb6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:45.387895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:45.676313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:45.677892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:45.780561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac70a3a-0ac3-4177-ae8c-3eb2e89da7b0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:45.813679 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:45.855214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:45.855849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:45.856128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:45.856396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:45.857978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:45.966329 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:45.967802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fa026-7f11-411b-af56-f590a7ffa828 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:45.988478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 728/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:48.071838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.072426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.072426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.073808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:48.079264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1b36c-9c49-4634-b65b-9ad595974030 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.079700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1b36c-9c49-4634-b65b-9ad595974030 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.079858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1b36c-9c49-4634-b65b-9ad595974030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.147266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-9ce1b36c-9c49-4634-b65b-9ad595974030 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:48.148510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9ce1b36c-9c49-4634-b65b-9ad595974030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:48.162083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:48.247893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:48.545604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:48.547158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:48.650166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185fed3d-eac8-4219-8c1d-1341f62b81e6 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:48.661971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:48.723398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:48.723964 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:48.724249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:48.724520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:48.726113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:48.837509 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:48.838967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23d87e-6389-47d4-be8e-98bd95b2732a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:48.857390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 717/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:51.075444 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:51.076067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:51.076067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:51.077413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:51.083063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28b32-a1b1-41b0-86e9-2b60641b8796 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:51.083512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28b32-a1b1-41b0-86e9-2b60641b8796 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:51.083619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d28b32-a1b1-41b0-86e9-2b60641b8796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:51.133614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:51.151663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-05d28b32-a1b1-41b0-86e9-2b60641b8796 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:51.152904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-05d28b32-a1b1-41b0-86e9-2b60641b8796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:51.252309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:51.539396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:51.541266 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:51.647006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f36aa0-f39b-4282-afed-4be85d848a51 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:51.685810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:51.720249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:51.720914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:51.721265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:51.721583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:51.723252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:51.833488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:51.834854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8479f-35e0-410e-be72-7e8af3b8cd33 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:51.853861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 731/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:53.927351 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.927959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.927959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:53.929741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:53.935215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a98ce4-5cd4-42cd-8e50-41cfd6435d7e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:53.935668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a98ce4-5cd4-42cd-8e50-41cfd6435d7e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:53.935788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a98ce4-5cd4-42cd-8e50-41cfd6435d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:54.011892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-27a98ce4-5cd4-42cd-8e50-41cfd6435d7e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:54.013465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-27a98ce4-5cd4-42cd-8e50-41cfd6435d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:54.041645 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:54.141769 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:54.428750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:54.430301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:54.535136 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7040c16-2495-4d45-88d8-4a99faf7427f None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:54.556119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:54.611719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:54.612374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:54.612654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:54.612924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:54.614586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:54.722848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:54.724256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0039571-e4ab-4b8b-a857-9704415fad2c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:54.742343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 720/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:56.743167 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:56.743680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:56.743680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:56.745021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:56.750451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23001-cc27-4ce7-bc95-3abce18b9d74 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:56.750909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23001-cc27-4ce7-bc95-3abce18b9d74 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:56.751041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e23001-cc27-4ce7-bc95-3abce18b9d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:56.814474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:56.817686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-e7e23001-cc27-4ce7-bc95-3abce18b9d74 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:56.819562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e7e23001-cc27-4ce7-bc95-3abce18b9d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:56.921883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:57.205183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:57.207370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:57.311413 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f06ddd-1243-4aa9-b36d-01f1b4b6ed25 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:14:57.360127 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:57.385555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:14:57.386153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:57.386430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:57.386698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:57.388314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:57.496914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:14:57.498271 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32adbd-2cb9-4072-92ed-265857753b10 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:14:57.516891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 734/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:14:59.513715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:59.514259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:59.514259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:59.515526 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:14:59.521359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1d5d-f985-4b43-a480-335eb55acd5a None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:14:59.521763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1d5d-f985-4b43-a480-335eb55acd5a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:14:59.521905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1d5d-f985-4b43-a480-335eb55acd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:14:59.589223 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-395a1d5d-f985-4b43-a480-335eb55acd5a None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:14:59.590431 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-395a1d5d-f985-4b43-a480-335eb55acd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:14:59.620495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:14:59.691305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:14:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:14:59.976015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:14:59.977556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:00.081818 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fbf0e-f836-44dc-918b-a0031d3451db None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:00.109357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:00.154902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:00.155596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:00.155913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:00.156195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:00.157787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:00.265842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:00.267281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3dd61-1aea-45c9-ba57-fa12107b2cfd service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:00.286710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 723/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:14:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:02.243105 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.243653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.243653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.245048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:02.250312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440934dc-ea21-49d7-941a-e359b33ec6c0 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.250756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440934dc-ea21-49d7-941a-e359b33ec6c0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.250860 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440934dc-ea21-49d7-941a-e359b33ec6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.318842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-440934dc-ea21-49d7-941a-e359b33ec6c0 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:02.320080 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-440934dc-ea21-49d7-941a-e359b33ec6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:02.328534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:02.419201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:02.711120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:02.712701 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:02.817018 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cada3-392f-4061-9f5e-8a1887ab02bf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:02.875131 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:02.894563 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:02.895174 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:02.895453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:02.895725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:02.897350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:03.009227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:03.010669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7e882-eaeb-4a08-a405-9d0c33d62a57 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:03.029684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 737/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:04.989147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:04.990803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:04.990803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:04.992757 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:15:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:04.998620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6ad7-c474-4704-b649-5f8db89375da None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:04.999072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6ad7-c474-4704-b649-5f8db89375da None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:04.999206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef6ad7-c474-4704-b649-5f8db89375da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:05.066466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-34ef6ad7-c474-4704-b649-5f8db89375da None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:05.067687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34ef6ad7-c474-4704-b649-5f8db89375da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:05.106306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:05.164918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:05.451984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:05.453532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:05.559597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ad65-e91a-42d1-aa2d-f08ef4f4b3ac None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:05.598709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:05.635049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:05.635651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:05.635978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:05.636240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:05.637844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:05.747248 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:05.748637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992b2afb-e3b6-49e4-8ee0-6db1e5a4834c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:05.767293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 726/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:07.694262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.694807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.694908 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.696276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:07.701510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce2a4-fffb-40a3-b5c5-d56c6d3d28b8 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:07.701955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce2a4-fffb-40a3-b5c5-d56c6d3d28b8 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:07.702062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ce2a4-fffb-40a3-b5c5-d56c6d3d28b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:07.770238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-1e1ce2a4-fffb-40a3-b5c5-d56c6d3d28b8 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:07.771520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-1e1ce2a4-fffb-40a3-b5c5-d56c6d3d28b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:07.789941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:07.870488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:08.152850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:08.154415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:08.275316 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af20a8-64ea-4a25-9912-1eddfc95afd0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:08.343366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:08.350669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:08.351282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:08.351564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:08.351873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:08.353498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:08.464412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:08.465849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff214b-4293-4cf0-8e3c-bc13fd8b149d service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:08.484011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 740/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:10.420863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.421461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.421461 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.422794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:10.428638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5109a-5822-458b-a4b8-1847e47dd5a3 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:10.429011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5109a-5822-458b-a4b8-1847e47dd5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:10.429170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5109a-5822-458b-a4b8-1847e47dd5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:10.495496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5ee5109a-5822-458b-a4b8-1847e47dd5a3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:10.496738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5ee5109a-5822-458b-a4b8-1847e47dd5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:10.546593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:10.595428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:10.883991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:10.885539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:10.991817 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8755f27-7c42-4eaa-a21d-0c2a497bc3d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:11.041269 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:11.069275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:11.069891 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:11.070175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:11.070451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:11.072098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:11.186340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:11.187686 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daaab5-11e5-4b2e-a7cf-96d341161ec2 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:11.205724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 729/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:20.593616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=22 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:21.203319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=66 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.031324 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1721-6298-43d5-825c-21f0257ab6b5 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.031924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1721-6298-43d5-825c-21f0257ab6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.031924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce1721-6298-43d5-825c-21f0257ab6b5 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.033371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 742/1471] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:31.038814 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143cf6a-862f-4138-8168-c463cbefd3d2 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.039270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143cf6a-862f-4138-8168-c463cbefd3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.039375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143cf6a-862f-4138-8168-c463cbefd3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.105214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-2143cf6a-862f-4138-8168-c463cbefd3d2 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:31.106487 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-2143cf6a-862f-4138-8168-c463cbefd3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:31.204070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 730/1472] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:31.508730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.509017 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.509293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.510633 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 743/1473] 10.222.0.70 () {54 vars in 967 bytes} [Tue Aug 23 23:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:31.515490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a919-13ce-4490-bc25-4d9472c6dc8a None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.515811 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a919-13ce-4490-bc25-4d9472c6dc8a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.516094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860a919-13ce-4490-bc25-4d9472c6dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.593998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-4860a919-13ce-4490-bc25-4d9472c6dc8a None None] MFA Rules not processed for user `b95d02dc83464209b536460b970d024b`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:31.595207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-4860a919-13ce-4490-bc25-4d9472c6dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:31.616153 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.672093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 731/1474] 10.222.0.70 () {58 vars in 1064 bytes} [Tue Aug 23 23:15:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:31.679971 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:31.681542 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:31.788687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf637389-a212-45b3-a9db-d65335af9dc8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:31.860993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95d02dc83464209b536460b970d024b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:31.861650 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:31.862050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:31.862344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:31.863975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:31.918808 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:31.974861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:31.976336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e806f-0e24-4d14-bc09-aead87b89009 service glance] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:31.994784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 744/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:34.002941 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:34.003803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:34.003803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:34.005144 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 732/1476] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:34.010419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d591aa-5638-4f21-95d4-0bb8a582e970 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:34.010844 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d591aa-5638-4f21-95d4-0bb8a582e970 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:34.010968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d591aa-5638-4f21-95d4-0bb8a582e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:34.076968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-11d591aa-5638-4f21-95d4-0bb8a582e970 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:34.078194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-11d591aa-5638-4f21-95d4-0bb8a582e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:34.176533 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 745/1477] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:34.452414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:34.453994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:34.583975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847566c8-8078-4338-9fd2-b99c6612524a None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:34.632424 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:34.677322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:34.677925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:34.678203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:34.678470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:34.679102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:34.680884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:15:34.680884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:15:34.680884 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:15:34.682031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714f2a-87d7-4935-9114-e1ff4fc921bd admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:34.700331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 733/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 23 23:15:34 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:15:36.645709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.646260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.646260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.647685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 746/1479] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:36.652933 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a13d1-6b58-4402-854f-d9a7b85bce75 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:36.653359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a13d1-6b58-4402-854f-d9a7b85bce75 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:36.653474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812a13d1-6b58-4402-854f-d9a7b85bce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:36.718888 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-812a13d1-6b58-4402-854f-d9a7b85bce75 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:36.720072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-812a13d1-6b58-4402-854f-d9a7b85bce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:36.816610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 734/1480] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:37.114656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:37.116259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:37.127850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:37.265497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0b6d4-0be6-4f0d-abbe-24afe01aeda2 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:37.345057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:37.379066 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:37.379596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:37.379901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:37.380168 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:37.381754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:37.469930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:37.472184 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f5dd-e412-4d2f-8a40-b3d2ed566203 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:37.491115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 747/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:39.604002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:39.604567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:39.604567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:39.605900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 735/1482] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:39.611138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0d41-c79b-41e6-ad80-6ed9c1b136a6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:39.612441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0d41-c79b-41e6-ad80-6ed9c1b136a6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:39.612441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0d41-c79b-41e6-ad80-6ed9c1b136a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:39.678486 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-34df0d41-c79b-41e6-ad80-6ed9c1b136a6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:39.679713 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34df0d41-c79b-41e6-ad80-6ed9c1b136a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:39.725500 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:39.778162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 748/1483] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:40.065152 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:40.066787 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:40.090489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:40.178975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c41d1-c7dd-45be-9a89-1f2431f4c9d2 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:40.253120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:40.253990 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:40.254276 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:40.254555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:40.256206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:40.332175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:40.368622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:40.370069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee968d8-fc58-43e4-b5c0-9b74901d2f7a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:40.388283 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 736/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:42.373607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:42.374169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:42.374169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:42.375529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 749/1485] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:42.381407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef871-2ae9-414d-82af-e3519c06f52f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:42.381869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef871-2ae9-414d-82af-e3519c06f52f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:42.381977 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ef871-2ae9-414d-82af-e3519c06f52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:42.447600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-258ef871-2ae9-414d-82af-e3519c06f52f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:42.449110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-258ef871-2ae9-414d-82af-e3519c06f52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:42.558557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 737/1486] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:42.858328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:42.859912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:42.965493 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4685f9cd-a74b-4b7f-af76-333afcb31c23 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:43.038975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:43.040822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:43.041791 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:43.042285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:43.042736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:43.044384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:43.153631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:43.155089 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fe20a-7d7f-40f5-84b1-587ade41d931 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:43.174672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 750/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:45.219476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.220087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.220087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.221754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 738/1488] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:45.227100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ab4b3-1a35-4a66-96ad-44da302181e7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.227556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ab4b3-1a35-4a66-96ad-44da302181e7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.227656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ab4b3-1a35-4a66-96ad-44da302181e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.293485 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-712ab4b3-1a35-4a66-96ad-44da302181e7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:45.294681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-712ab4b3-1a35-4a66-96ad-44da302181e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:45.348056 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:45.393425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 751/1489] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:45.688224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:45.689902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:45.726221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:45.796714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb174bba-4dd4-4af6-9efc-68934ebe4e51 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:45.871120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:45.871743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:45.872060 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:45.872340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:45.874057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:45.956382 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:45.986333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:45.987855 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4999ca2-5d89-48a0-9a51-1db320c6c73b service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:46.007389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 739/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:48.095738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:48.096305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:48.096305 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:48.097674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 752/1491] 10.222.0.70 () {54 vars in 927 bytes} [Tue Aug 23 23:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:15:48.102870 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1f56-27d3-46e6-8eb9-c81b21b6fa18 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:48.103265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1f56-27d3-46e6-8eb9-c81b21b6fa18 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:48.103429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eee1f56-27d3-46e6-8eb9-c81b21b6fa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:48.168842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5eee1f56-27d3-46e6-8eb9-c81b21b6fa18 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:15:48.170064 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5eee1f56-27d3-46e6-8eb9-c81b21b6fa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:48.265388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 740/1492] 10.222.0.70 () {58 vars in 1024 bytes} [Tue Aug 23 23:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:15:48.555951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:15:48.557494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:48.660750 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1381ed-15ef-4188-9e30-3a6918cefdf8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:15:48.733821 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:15:48.734357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:15:48.734642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:15:48.734946 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:15:48.736970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:15:48.747047 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:48.852725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:15:48.854171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9a77d-6a49-4681-afa7-c2882dacc2ca service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:15:48.873790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 753/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:15:58.263540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=82 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:15:58.871404 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=50 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:06.428734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:06.429341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:06.429341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:06.506409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:06.507663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:06.609232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 741/1494] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:06.617924 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:06.618432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:06.618532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:06.694002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:06.695147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:06.793383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 754/1495] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:06.798778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:06.800015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:06.811448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d928ee6-8d27-4c41-b41e-a0258e69e6b3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:06.872176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:06.908003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:06.908609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:06.908889 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:06.909158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:06.909794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:17:06.910094 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:06.911096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:06.911096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:17:06.911096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:17:06.912004 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:06.923584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 742/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 23 23:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:17:06.931988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:06.942058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e1cac-290d-482b-aa4c-9d9875bbb26b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:07.003062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:07.036315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:07.036956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.037236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.037510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.038173 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:07.039986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:07.039986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:17:07.039986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:17:07.041193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:07.096947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 755/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 23 23:17:06 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:07.101221 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:07.102738 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:07.137218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e60765-0c8f-493b-91e7-55c12938e841 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:07.231607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:07.232293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.232580 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.232858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.233496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:07.234516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:07.234516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:17:07.234516 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:17:07.236675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:07.277943 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 743/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:17:07 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:17:07.282610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:07.284156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:07.345887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdb0ce-2aae-428e-a361-90432f941deb admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:07.428956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:07.441050 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:07.441674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.441936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.442207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.442848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:07.443883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:07.443883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:17:07.443883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:17:07.444774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:07.456906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 756/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:17:07.461194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:07.462722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:07.474739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1330fe-76c9-46be-8be3-df44620e952b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:07.500220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:07.574798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:07.575415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.575697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.576014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.576693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:07.577741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:07.577741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:17:07.577741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:17:07.578661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f44d9c-0c43-4966-bd3b-5a5a72164fc4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:07.591049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 744/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:17:07 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:17:07.595507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:07.597098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:07.630972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb41b-ba58-4a34-820d-10c3e6b4e51a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:07.723417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:07.724100 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.724375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.724646 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] PATH_INFO: `/v3/projects/34eef8c6ebed4fdbb5542b6dd96dd2b2/users/99fc30db35c241a2b47a5907103d9005/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.746178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34eef8c6ebed4fdbb5542b6dd96dd2b2, user_id=99fc30db35c241a2b47a5907103d9005, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:07.747203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:07.747203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:17:07.747203 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:17:07.749194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e516aa-9ad8-4959-9117-b4de2947f273 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:07.773765 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 757/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:17:07 2022] PUT /identity/v3/projects/34eef8c6ebed4fdbb5542b6dd96dd2b2/users/99fc30db35c241a2b47a5907103d9005/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:17:07.786514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366142c3-cde0-4cd2-b3a2-79dde69bc088 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.786740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366142c3-cde0-4cd2-b3a2-79dde69bc088 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.787024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366142c3-cde0-4cd2-b3a2-79dde69bc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.845306 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-366142c3-cde0-4cd2-b3a2-79dde69bc088 None None] MFA Rules not processed for user `99fc30db35c241a2b47a5907103d9005`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:07.846576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-366142c3-cde0-4cd2-b3a2-79dde69bc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:07.927156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 745/1502] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:17:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:07.940773 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.941062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.941339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.942693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 758/1503] 10.222.0.70 () {54 vars in 964 bytes} [Tue Aug 23 23:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:07.947449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8f13-de8d-4221-9c29-5db112a23023 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:07.947737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8f13-de8d-4221-9c29-5db112a23023 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:07.948041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b8f13-de8d-4221-9c29-5db112a23023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:07.979806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:08.144098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c10b8f13-de8d-4221-9c29-5db112a23023 None None] MFA Rules not processed for user `bea41ec6a516482e89cbcd12344250e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:08.145347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c10b8f13-de8d-4221-9c29-5db112a23023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:08.221562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 746/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Aug 23 23:17:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:08.229207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:08.230718 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:08.281116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:08.337779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75732b3a-5092-4eb7-a3bf-f2ea26d70bcd None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:08.411848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea41ec6a516482e89cbcd12344250e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:08.412390 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:08.412675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:08.412968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:08.414567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:08.513512 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:08.515532 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:08.519290 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:08.534409 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 759/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:17:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:08.584432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700e57-1749-4658-9768-ccf46a617338 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:08.584875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700e57-1749-4658-9768-ccf46a617338 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:08.584981 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6700e57-1749-4658-9768-ccf46a617338 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:08.586260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 747/1506] 10.222.0.70 () {52 vars in 830 bytes} [Tue Aug 23 23:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:17:08.589784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:08.591015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:08.690196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520b19c-8cd0-4634-b3c4-563bd7efcfe2 service cinder] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:08.786740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:08.787373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:08.787655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:08.787962 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] PATH_INFO: `/v3/users/99fc30db35c241a2b47a5907103d9005` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:08.801033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fc30db35c241a2b47a5907103d9005)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:08.802063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:08.802063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:17:08.802063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:17:08.803315 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:08.813414 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:08.873789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fc30db35c241a2b47a5907103d9005'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:08.874224 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fc30db35c241a2b47a5907103d9005'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:08.897412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fc30db35c241a2b47a5907103d9005'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:08.906614 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fc30db35c241a2b47a5907103d9005'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:08.921341 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fc30db35c241a2b47a5907103d9005'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:08.928202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 760/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 23 23:17:08 2022] DELETE /identity/v3/users/99fc30db35c241a2b47a5907103d9005 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:17:08.932571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:08.932854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:08.933122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:08.990308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:17:08.991440 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:09.070571 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:09.089034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 748/1508] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:17:09.098813 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:09.100122 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:09.199433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f0597-10f3-48dc-92e6-1673bb7bf503 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:09.261151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:09.282405 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:09.283020 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:09.283297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:09.283569 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:09.285201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:09.396388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:09.397842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb2128-1575-4439-ac49-6c250b7515d9 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:09.416442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 761/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:17:09.774914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:17:09.776262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:17:09.788110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ecab2-6433-4c8d-acc4-85acd7984242 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:17:09.888268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:17:09.888900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:17:09.889183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:17:09.889456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] PATH_INFO: `/v3/projects/34eef8c6ebed4fdbb5542b6dd96dd2b2` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:17:09.899823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=34eef8c6ebed4fdbb5542b6dd96dd2b2)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:17:09.900907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:17:09.900907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:17:09.900907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:17:09.902170 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:17:09.958572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34eef8c6ebed4fdbb5542b6dd96dd2b2', 'request_id': 'req-52b77312-3fae-45e3-bdf0-f4c57ff396fb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:09.968906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34eef8c6ebed4fdbb5542b6dd96dd2b2', 'request_id': 'req-52b77312-3fae-45e3-bdf0-f4c57ff396fb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:09.982369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34eef8c6ebed4fdbb5542b6dd96dd2b2', 'request_id': 'req-52b77312-3fae-45e3-bdf0-f4c57ff396fb'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:10.007471 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] The token cache is being invalidate because project 34eef8c6ebed4fdbb5542b6dd96dd2b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81583) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:17:10.007788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:10.008331 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-52b77312-3fae-45e3-bdf0-f4c57ff396fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:17:10.009638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 749/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 23 23:17:09 2022] DELETE /identity/v3/projects/34eef8c6ebed4fdbb5542b6dd96dd2b2 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:17:19.414134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=62 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:17:20.004900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:28.622953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.623520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.623520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.624948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:28.630641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e605-b2a9-4f93-a62c-57fc6dc78e4f None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:28.631070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e605-b2a9-4f93-a62c-57fc6dc78e4f None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:28.631185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278e605-b2a9-4f93-a62c-57fc6dc78e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:28.711653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-3278e605-b2a9-4f93-a62c-57fc6dc78e4f None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:28.712909 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-3278e605-b2a9-4f93-a62c-57fc6dc78e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:28.817510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:28.970006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:28.972189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:29.096069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27d118a-b63f-4820-9137-ceb9a78c3751 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:29.102342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:29.102952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.103237 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.103515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.111528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:29.113154 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0d3ab-e232-4735-be83-de4adc90a0a8 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:29.122782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 763/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:29.972002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912820-8313-4982-b12a-afd86508bef0 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.972573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912820-8313-4982-b12a-afd86508bef0 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.972682 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7912820-8313-4982-b12a-afd86508bef0 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:29.974519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:29.979429 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096dde-74a0-45d5-9670-9e727c2babbb None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:29.979920 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096dde-74a0-45d5-9670-9e727c2babbb None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:29.980027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64096dde-74a0-45d5-9670-9e727c2babbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.000012 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-64096dde-74a0-45d5-9670-9e727c2babbb None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:30.001210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-64096dde-74a0-45d5-9670-9e727c2babbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:30.009369 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:30.163135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7912820-8313-4982-b12a-afd86508bef0 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:30.178110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7912820-8313-4982-b12a-afd86508bef0 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:30.183557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:30.184177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:30.184460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:30.184735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:30.192940 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:30.194572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685c6b7-7f21-47fd-9e9d-6dddd6ade00e service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:30.203988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 752/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:33.780508 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f98a1d-ecec-4bc9-8a43-9dd7c6cd0024 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.781109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f98a1d-ecec-4bc9-8a43-9dd7c6cd0024 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.781109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f98a1d-ecec-4bc9-8a43-9dd7c6cd0024 None None] PATH_INFO: `/v3` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.782353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 765/1517] 10.222.0.57 () {54 vars in 925 bytes} [Tue Aug 23 23:18:33 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 23 23:18:33.789328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13211-d7bf-46e2-afd4-ff3ca68faaf4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:33.789784 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13211-d7bf-46e2-afd4-ff3ca68faaf4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:33.789893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff13211-d7bf-46e2-afd4-ff3ca68faaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:33.849138 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-cff13211-d7bf-46e2-afd4-ff3ca68faaf4 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:33.850377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-cff13211-d7bf-46e2-afd4-ff3ca68faaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:33.867135 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:33.922478 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 753/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 23 23:18:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:39.995267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=56 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:41.423207 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562a8d-0f4c-4c86-b321-8df7fd7c451a None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.423900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562a8d-0f4c-4c86-b321-8df7fd7c451a None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.423900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9562a8d-0f4c-4c86-b321-8df7fd7c451a None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.425211 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 766/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:41.430373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27673-770e-45b9-bd55-8e45ac928436 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.430797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27673-770e-45b9-bd55-8e45ac928436 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.430914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f27673-770e-45b9-bd55-8e45ac928436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.450939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-38f27673-770e-45b9-bd55-8e45ac928436 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:41.452171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-38f27673-770e-45b9-bd55-8e45ac928436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:41.460689 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 754/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:41.614859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562a8d-0f4c-4c86-b321-8df7fd7c451a None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:41.629176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9562a8d-0f4c-4c86-b321-8df7fd7c451a None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:41.635721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:41.636354 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:41.636637 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:41.636911 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:41.645035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:41.646743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e001e1-002d-4690-b71c-9e8faa45350f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:41.656158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 767/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:18:42.481710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2ab8d-8a2c-464a-a3ff-9153ef4fc1da None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.482303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2ab8d-8a2c-464a-a3ff-9153ef4fc1da None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.482303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab2ab8d-8a2c-464a-a3ff-9153ef4fc1da None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.483657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 23 23:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:42.488527 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2d42-e080-4a78-9cab-f9a885bc5482 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.488936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2d42-e080-4a78-9cab-f9a885bc5482 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.489707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed2d42-e080-4a78-9cab-f9a885bc5482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.509680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-34ed2d42-e080-4a78-9cab-f9a885bc5482 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:42.510887 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-34ed2d42-e080-4a78-9cab-f9a885bc5482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:42.518897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 23 23:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:42.677243 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2ab8d-8a2c-464a-a3ff-9153ef4fc1da None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:42.692230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab2ab8d-8a2c-464a-a3ff-9153ef4fc1da None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:42.698353 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:42.698954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:42.699230 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:42.699502 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:42.708944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:42.710625 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec56ce5-ec1e-408f-bc54-5e8a3d7f72c5 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:42.720797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 756/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:43.033102 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd675df-3efb-4b55-8e89-4d061a8e36e3 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.033311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd675df-3efb-4b55-8e89-4d061a8e36e3 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.033567 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd675df-3efb-4b55-8e89-4d061a8e36e3 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.034952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 769/1525] 10.222.0.70 () {54 vars in 961 bytes} [Tue Aug 23 23:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:43.040740 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae49f8-96f0-478b-ac6e-3741dcf0ee30 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.041034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae49f8-96f0-478b-ac6e-3741dcf0ee30 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.041398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae49f8-96f0-478b-ac6e-3741dcf0ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.061806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-5fae49f8-96f0-478b-ac6e-3741dcf0ee30 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:43.063009 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-5fae49f8-96f0-478b-ac6e-3741dcf0ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:43.071510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 757/1526] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Aug 23 23:18:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:43.078854 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd675df-3efb-4b55-8e89-4d061a8e36e3 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:43.093038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd675df-3efb-4b55-8e89-4d061a8e36e3 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:43.098005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:43.099215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:43.099499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:43.099812 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:43.108145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:43.109721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae0460-2630-4cc9-a046-12839b6b0a44 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:43.119270 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 770/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:46.525564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.526213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.526213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.527559 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:46.532869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6bb82-ee21-42d0-b9de-f5f6bd58ccf6 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.533334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6bb82-ee21-42d0-b9de-f5f6bd58ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.533442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af6bb82-ee21-42d0-b9de-f5f6bd58ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.554370 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1af6bb82-ee21-42d0-b9de-f5f6bd58ccf6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:46.555577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1af6bb82-ee21-42d0-b9de-f5f6bd58ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:46.563481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:46.856535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:46.858344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:46.937782 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72800bb6-3b7e-4e18-9c97-d8948fdfd4da None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:46.941547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:46.942155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:46.942443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:46.942719 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:46.952566 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:46.954003 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7b70-3d8d-4ffd-89f7-a652ac8ff411 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:46.963453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 759/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:48.908103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9c27-904e-4f2e-8d76-e0dbd159f9e0 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.908725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9c27-904e-4f2e-8d76-e0dbd159f9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.908725 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712b9c27-904e-4f2e-8d76-e0dbd159f9e0 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.910048 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:48.916156 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0522-ebba-4f33-965a-b2e48e7e93c1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:48.916611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0522-ebba-4f33-965a-b2e48e7e93c1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:48.916717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e0522-ebba-4f33-965a-b2e48e7e93c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:48.936160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-fc1e0522-ebba-4f33-965a-b2e48e7e93c1 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:48.937367 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-fc1e0522-ebba-4f33-965a-b2e48e7e93c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:48.946557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:49.235709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b9c27-904e-4f2e-8d76-e0dbd159f9e0 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:49.248624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712b9c27-904e-4f2e-8d76-e0dbd159f9e0 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:49.252222 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:49.252823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:49.253106 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:49.253381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:49.263568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:49.265049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68fa0f-2e18-44ee-82d3-989836021c5c service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:49.275246 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 773/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:52.633709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.634226 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.634350 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.635621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:52.640858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15ac3-759b-4601-aca0-e17949912fd4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:52.641285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15ac3-759b-4601-aca0-e17949912fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:52.641428 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c15ac3-759b-4601-aca0-e17949912fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:52.660875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-77c15ac3-759b-4601-aca0-e17949912fd4 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:52.662115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-77c15ac3-759b-4601-aca0-e17949912fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:52.670655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:53.218918 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:53.220616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:53.284737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=100 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:18:53.298319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0180f47-597b-4c94-80b7-4cd8c1b202c3 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:53.301955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea41ec6a516482e89cbcd12344250e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:53.302562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:53.302848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:53.303125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:53.312742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:53.314166 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c85e0a-a2b4-49ee-b8d4-30f50bef4f0b service cinder] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:53.324300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 762/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:18:55.248930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.249499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.249499 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:55.250835 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 23 23:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:18:55.256475 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba919-1ee1-4f49-8ea9-b837bec5a65e None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.256861 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba919-1ee1-4f49-8ea9-b837bec5a65e None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.257030 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ba919-1ee1-4f49-8ea9-b837bec5a65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:55.276926 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-304ba919-1ee1-4f49-8ea9-b837bec5a65e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:18:55.278146 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-304ba919-1ee1-4f49-8ea9-b837bec5a65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:55.285992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 23 23:18:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:18:55.840621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:18:55.843524 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:18:55.857408 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a57119-2544-4759-baa8-736df4c8ab90 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:18:55.860950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea41ec6a516482e89cbcd12344250e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:18:55.861553 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:18:55.861839 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:18:55.862118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:18:55.871051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:18:55.872519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e78dcc-3bc4-4ce1-8be5-0de74e506b60 service cinder] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:18:55.882206 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 776/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:19:05.271505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=11 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:19:05.877681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=33 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:12.009955 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82770-e795-421c-82d7-3a0bb6b2eff6 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.010574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82770-e795-421c-82d7-3a0bb6b2eff6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.010681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82770-e795-421c-82d7-3a0bb6b2eff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.023520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e171-dd4a-4a3f-b302-9ec9c6b99ad7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.024088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e171-dd4a-4a3f-b302-9ec9c6b99ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.024210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8e171-dd4a-4a3f-b302-9ec9c6b99ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.031538 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-15b82770-e795-421c-82d7-3a0bb6b2eff6 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.032932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-15b82770-e795-421c-82d7-3a0bb6b2eff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.041489 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 764/1540] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:12.044091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f0e8e171-dd4a-4a3f-b302-9ec9c6b99ad7 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.045282 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f0e8e171-dd4a-4a3f-b302-9ec9c6b99ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.049432 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.049717 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.049989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.053035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 777/1541] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:12.061699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.061985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.062264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.069374 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.070568 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.078402 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 765/1542] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:12.081476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.082848 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.082967 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.091096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 778/1543] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:12.092007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0701f1-dae5-4069-a93a-5e85d5660855 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.095592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.096588 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.097176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.097451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.097722 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] PATH_INFO: `/v3/domains` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.098361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81583) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:12.098660 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.100303 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.105520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12c62b-dcaf-4fee-bb0e-15e4e525a07d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.110890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.111488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.111788 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.112071 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.112604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 766/1544] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:20:12.112810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81584) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 23 23:20:12.113019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.114034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:12.114034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:20:12.114034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:20:12.114938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.120935 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.127652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 779/1545] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 23 23:20:12.131978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1398d-88dc-4391-b291-76e01e5bc59f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.135805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.136753 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.137343 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.137622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.137893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.138507 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.139518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:12.139518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:20:12.139518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:20:12.140741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.145795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139519a-ac96-4c1f-a8ae-6533a4fa77c1 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.151021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.151622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.151939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.152215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.152846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.154795 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.183809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 767/1546] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:12.184049 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 780/1547] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:20:12.185737 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.187561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.248311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32607455-5c24-44fa-a1ff-03643f7f5cd9 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.249410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286ec42-f7a1-47c3-a8d9-223b8f47c49a admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.252992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.253623 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.253901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.254176 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.254416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.254793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.255016 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.255561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.255859 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.257005 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.258731 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.261078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:12.261078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:20:12.261078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:20:12.262255 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.279668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 768/1548] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:20:12.283774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.283956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 781/1549] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:12.287697 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.293577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f13fe4-f453-4f25-8d41-1a1a1d03ea2a admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.297985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4b1d1-4d46-4b71-ae21-3f4dc7f58f2b admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.298242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.298843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.299129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.299403 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.300074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.301676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.302630 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.303215 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.303491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.304034 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.304418 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.306680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.312386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 769/1550] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:20:12.316443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.316931 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 782/1551] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:20:12.320952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.326939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a01c760-dec7-4b1e-b0fe-254383ccc92b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.331624 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.332188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b07f482-8405-492e-8e5c-b31b9cde5b50 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.332326 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.332540 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.332801 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.333445 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.335078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.337398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.337985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.338261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.338528 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.339160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.340766 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.346010 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 770/1552] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:20:12.350057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.352366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 783/1553] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 23 23:20:12.356730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.359776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638f776-45d9-477e-b474-7da1c55dccb2 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.364426 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.365067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.365347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.365622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] PATH_INFO: `/v3/projects/dae066ec7ed7493cb7b1001057ab1396/users/6c9d2e88818b4c758d438f85659a0ada/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.366385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b9833-399b-4649-bee4-9631422cdfd3 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.372044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.372723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.373133 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.373307 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] PATH_INFO: `/v3/projects/40c55d7810214bb6a453afb56a9453ca/users/c6ce435ca5a4421baafe1d249d908df1/roles/68313c4b2f044fd184b6941eae76cd3a` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.380956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae066ec7ed7493cb7b1001057ab1396, user_id=6c9d2e88818b4c758d438f85659a0ada, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.381983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:20:12.381983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:20:12.381983 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:20:12.384596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee6239-b7eb-4ff1-bca5-acbb84c17b88 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.389562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c55d7810214bb6a453afb56a9453ca, user_id=c6ce435ca5a4421baafe1d249d908df1, role_id=68313c4b2f044fd184b6941eae76cd3a)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.392604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea77b8a-2a76-47a4-ac84-8ce36c421766 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.398544 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 771/1554] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:12 2022] PUT /identity/v3/projects/dae066ec7ed7493cb7b1001057ab1396/users/6c9d2e88818b4c758d438f85659a0ada/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:20:12.403635 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088450-07fb-4881-b189-5f56d616a366 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.403986 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088450-07fb-4881-b189-5f56d616a366 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.404264 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57088450-07fb-4881-b189-5f56d616a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.406038 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 784/1555] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:12 2022] PUT /identity/v3/projects/40c55d7810214bb6a453afb56a9453ca/users/c6ce435ca5a4421baafe1d249d908df1/roles/68313c4b2f044fd184b6941eae76cd3a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:20:12.411027 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.411361 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.411681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.423640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-57088450-07fb-4881-b189-5f56d616a366 None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.424885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-57088450-07fb-4881-b189-5f56d616a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.430469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] MFA Rules not processed for user `e0ca15452b034174ab0e683ef8b23043`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:12.431688 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.469201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:12.479816 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:12.488495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 772/1556] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:12.494332 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 785/1557] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:12.502334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088450-07fb-4881-b189-5f56d616a366 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.504966 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:12.506598 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:12.564900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f49d3-f220-45de-85c9-6c5f2925847e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.571906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57088450-07fb-4881-b189-5f56d616a366 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:12.572129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.572129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.572129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.572129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.573897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:12.574515 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:12.575317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:12.575317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:12.581561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.583220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a4539-551f-469a-acd3-5ec0ada7657a service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.585195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:12.587340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:12.595280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 786/1558] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:12.599219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 773/1559] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:20:17.559225 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.559794 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.559915 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.606550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:17.608069 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:17.704520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 787/1560] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:17.708659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.727433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70bcfa-e20b-4df6-afbf-f9d7ead4657a service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.735178 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.736293 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.736772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.737615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] PATH_INFO: `/v3/projects` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.738593 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.742956 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.781322 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 774/1561] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 23 23:20:17 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:17.785886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.804333 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4f1e8c-6df2-4f79-b5f7-b6113129badf None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.903238 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.904643 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.904932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.905209 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] PATH_INFO: `/v3/users` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.906644 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.910240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.948309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 788/1562] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:17 2022] POST /identity/v3/users => generated 295 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:17.949657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:17.963925 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1379a53-869f-4ed5-9dfb-ec4ef30e905f admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:17.969120 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:17.969809 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:17.970268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:17.970729 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:17.971449 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:17.973232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:17.989518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 775/1563] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:17.991514 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.005653 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96ca58-da57-4731-9ea3-587f12a161cf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.020547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.021357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.021648 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.021921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] PATH_INFO: `/v3/projects/2b126e245f2e4f4698e2a2cf688f0620/users/d8fbdddc1a9347fea65232549cd3239f/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.053607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b126e245f2e4f4698e2a2cf688f0620, user_id=d8fbdddc1a9347fea65232549cd3239f, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.056880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.059668 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:18.080914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 789/1564] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:17 2022] PUT /identity/v3/projects/2b126e245f2e4f4698e2a2cf688f0620/users/d8fbdddc1a9347fea65232549cd3239f/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:20:18.085286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.099693 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a719ac-d657-4c1d-b699-11855f8b32d7 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.173312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.174035 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.174407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.174751 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.175474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.177885 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a11444-7c57-4a97-8d03-2f6669c6b538 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.195815 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 776/1565] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:18.199535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:18.212607 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae5303-d72b-4708-a092-ff61d723bcaf admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:18.229657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:18.231389 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] REQUEST_METHOD: `PUT` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:18.231901 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:18.232352 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] PATH_INFO: `/v3/projects/2b126e245f2e4f4698e2a2cf688f0620/users/d8fbdddc1a9347fea65232549cd3239f/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:18.234608 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b126e245f2e4f4698e2a2cf688f0620, user_id=d8fbdddc1a9347fea65232549cd3239f, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:18.237671 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:18.253529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 790/1566] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:18 2022] PUT /identity/v3/projects/2b126e245f2e4f4698e2a2cf688f0620/users/d8fbdddc1a9347fea65232549cd3239f/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:20:19.309082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.310261 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.310758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.359939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] MFA Rules not processed for user `c6ce435ca5a4421baafe1d249d908df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:19.362228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:19.441456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:19.500916 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 777/1567] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:19.506505 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:19.621539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f71cfa-aff1-4b42-9d8f-445cf2030453 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:19.628465 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:19.630111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.631065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.631562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.632453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:19.634875 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:19.680824 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 791/1568] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 23 23:20:19 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 23 23:20:19.684576 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:19.701615 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95dfee5-682f-4dda-860a-dec092a751f1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:19.841398 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:19.842053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.842344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.842627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.844097 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:19.845262 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:19.910546 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 778/1569] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 23 23:20:19 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 23 23:20:19.912867 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:19.930535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a65da98-9e5a-4ce4-a5f0-cbaaa47fb3c0 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:19.946053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:19.946883 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:19.947200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:19.947484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:19.948179 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:19.963523 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:19.997620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 792/1570] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:20.001309 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.019789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f6d55-2e0e-414a-b99a-709488393ed4 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.025339 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.026125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.026481 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.026772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] PATH_INFO: `/v3/projects/f0e8cca97e7a4130a00591e157dab06b/users/62128bf69e8b4c368775fce8fde40570/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.052998 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e8cca97e7a4130a00591e157dab06b, user_id=62128bf69e8b4c368775fce8fde40570, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.056680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.079200 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 779/1571] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:20 2022] PUT /identity/v3/projects/f0e8cca97e7a4130a00591e157dab06b/users/62128bf69e8b4c368775fce8fde40570/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:20:20.083236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.096947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb52b9-add2-430b-b3ae-766b2dd27b6e admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.217384 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.217989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.218381 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.218745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] PATH_INFO: `/v3/roles` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.219649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.221810 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d847a9e-ddff-4a92-b3af-52c0ea10beee admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.256317 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 793/1572] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 23 23:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 23 23:20:20.257468 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:20.273904 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e879a6c-c939-4df3-bdc8-137d91568c93 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:20.279806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:20.281021 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] REQUEST_METHOD: `PUT` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:20.282029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:20.282530 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] PATH_INFO: `/v3/projects/f0e8cca97e7a4130a00591e157dab06b/users/62128bf69e8b4c368775fce8fde40570/roles/fa42eaf240474f4086e94c0d56757850` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:20.284877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e8cca97e7a4130a00591e157dab06b, user_id=62128bf69e8b4c368775fce8fde40570, role_id=fa42eaf240474f4086e94c0d56757850)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:20.288683 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:20.332702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 780/1573] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 23 23:20:20 2022] PUT /identity/v3/projects/f0e8cca97e7a4130a00591e157dab06b/users/62128bf69e8b4c368775fce8fde40570/roles/fa42eaf240474f4086e94c0d56757850 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:20:24.357874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667126-fb7c-405a-a3ef-0a19133c90fe None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.358359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667126-fb7c-405a-a3ef-0a19133c90fe None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.358436 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0667126-fb7c-405a-a3ef-0a19133c90fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.399062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d0667126-fb7c-405a-a3ef-0a19133c90fe None None] MFA Rules not processed for user `d8fbdddc1a9347fea65232549cd3239f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:24.400547 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d0667126-fb7c-405a-a3ef-0a19133c90fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:24.461189 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:24.526233 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 794/1574] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:24.543910 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:24.546227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:24.705905 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219eeb4-5d8f-4858-b3b1-ee9fcd34c151 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:24.717842 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95d02dc83464209b536460b970d024b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:24.718611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:24.719519 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:24.719949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:24.799162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:24.855447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:24.856984 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:24.877002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 781/1575] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:20:25.877694 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe05-7603-498f-9a9e-226b4d3e6d91 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:25.878192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe05-7603-498f-9a9e-226b4d3e6d91 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:25.878192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403fe05-7603-498f-9a9e-226b4d3e6d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:25.911302 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-2403fe05-7603-498f-9a9e-226b4d3e6d91 None None] MFA Rules not processed for user `62128bf69e8b4c368775fce8fde40570`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:25.912573 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-2403fe05-7603-498f-9a9e-226b4d3e6d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:25.993249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 795/1576] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:26.006892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:26.016611 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df3fbe-7474-46cc-b1a2-338324f01e51 service glance] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:26.020328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95d02dc83464209b536460b970d024b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:26.020991 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.021210 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.021651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.092081 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:26.093778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28205de-a747-4c1e-90ca-9b9c4a06f7cb service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:26.105472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 782/1577] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:26.277510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.277796 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.278082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.339065 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:26.340435 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:26.403416 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.403902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.404278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.431690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:26.432803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:26.448125 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 796/1578] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:26.461240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 783/1579] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:26.587134 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:26.588790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:26.597123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:26.598700 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:26.650492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=100 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:26.714183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064cbb1b-6ba4-4385-b6cd-10d30a24b207 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:26.714410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983750f-0c8e-429a-a714-fe34f706705d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:26.720622 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:26.721054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:26.721259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.721549 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.721830 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.722251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:26.722902 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:26.723849 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:26.731638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:26.733313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cb6e9-1f08-47ff-90c9-1a296be18c23 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:26.740595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:26.743535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f9bd42-66c0-42d9-b27f-1d24df166cf2 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:26.744970 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 797/1580] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:20:26.759786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 784/1581] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:20:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 23 23:20:36.740192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=22 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:36.754347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=90 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:20:36.766654 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b531-3c93-4390-b478-c60b4e2154c4 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:36.766942 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b531-3c93-4390-b478-c60b4e2154c4 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:36.767232 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c280b531-3c93-4390-b478-c60b4e2154c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:36.792525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c280b531-3c93-4390-b478-c60b4e2154c4 None None] MFA Rules not processed for user `c6ce435ca5a4421baafe1d249d908df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:36.793621 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c280b531-3c93-4390-b478-c60b4e2154c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:36.802927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 798/1582] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:20:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:37.142072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71684-593f-4318-9626-69ef403ef6e6 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.142400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71684-593f-4318-9626-69ef403ef6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.142684 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec71684-593f-4318-9626-69ef403ef6e6 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.144083 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 785/1583] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 23 23:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:37.154044 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae122-49e5-4f92-821b-bedcb49eb669 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.155115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae122-49e5-4f92-821b-bedcb49eb669 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.155534 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae122-49e5-4f92-821b-bedcb49eb669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.208886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-046ae122-49e5-4f92-821b-bedcb49eb669 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:37.211008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-046ae122-49e5-4f92-821b-bedcb49eb669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:37.300051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 799/1584] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 23 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:37.306548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651ec4-9376-41b9-9e91-21d5ffd30878 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.306833 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651ec4-9376-41b9-9e91-21d5ffd30878 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.307115 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee651ec4-9376-41b9-9e91-21d5ffd30878 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.308845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 786/1585] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 23 23:20:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:37.315613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab94af-cc86-4835-a9bb-87c9c32ed85d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.316007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab94af-cc86-4835-a9bb-87c9c32ed85d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.316359 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab94af-cc86-4835-a9bb-87c9c32ed85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.340972 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-33ab94af-cc86-4835-a9bb-87c9c32ed85d None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:37.342208 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-33ab94af-cc86-4835-a9bb-87c9c32ed85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:37.353204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 800/1586] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:37.373213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee651ec4-9376-41b9-9e91-21d5ffd30878 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:37.393274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee651ec4-9376-41b9-9e91-21d5ffd30878 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:37.398344 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b95d02dc83464209b536460b970d024b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:37.399285 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.400011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.400518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.423433 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:37.425192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ca2c1-01bd-45cf-87a5-f90fca4a16bc service glance] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:37.442944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 787/1587] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:20:37.894604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979d6b-c26b-455f-87c3-209146d701d8 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.895286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979d6b-c26b-455f-87c3-209146d701d8 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.895286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5979d6b-c26b-455f-87c3-209146d701d8 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.896897 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 801/1588] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 23 23:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:37.903594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c86b-9b53-48ef-8f72-8d545c982826 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:37.904147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c86b-9b53-48ef-8f72-8d545c982826 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:37.904147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043c86b-9b53-48ef-8f72-8d545c982826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:37.955858 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-8043c86b-9b53-48ef-8f72-8d545c982826 None None] MFA Rules not processed for user `e8335dd9c12b44f885d60cff8f59e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:37.957300 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-8043c86b-9b53-48ef-8f72-8d545c982826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:38.012930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 788/1589] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:38.025196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5979d6b-c26b-455f-87c3-209146d701d8 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:38.036358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5979d6b-c26b-455f-87c3-209146d701d8 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:38.041096 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:38.041928 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.042274 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.042616 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.050721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:38.052204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a54523-1546-43b0-8b57-a745fb9550ae service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:38.060789 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 802/1590] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:38.469968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881689ef-3ad8-4e38-9766-fb8cb7cefe7c None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.470265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881689ef-3ad8-4e38-9766-fb8cb7cefe7c None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.470564 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881689ef-3ad8-4e38-9766-fb8cb7cefe7c None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.472320 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 789/1591] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 23 23:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:38.478900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50a0e-7e5e-49fe-9662-b87a6ed6b598 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.479196 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50a0e-7e5e-49fe-9662-b87a6ed6b598 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.479525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e50a0e-7e5e-49fe-9662-b87a6ed6b598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.489032 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e920-216c-47e6-b4d2-9d53405ed6e1 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.489349 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e920-216c-47e6-b4d2-9d53405ed6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.489638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e920-216c-47e6-b4d2-9d53405ed6e1 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.491129 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 790/1592] 10.222.0.70 () {54 vars in 961 bytes} [Tue Aug 23 23:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:38.499054 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.502058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.502484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.503876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f1e50a0e-7e5e-49fe-9662-b87a6ed6b598 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:38.505109 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f1e50a0e-7e5e-49fe-9662-b87a6ed6b598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:38.517638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 803/1593] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 23 23:20:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:38.523334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e95c9-8bce-443e-a38c-b83018c8a561 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.523721 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e95c9-8bce-443e-a38c-b83018c8a561 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.524041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7e95c9-8bce-443e-a38c-b83018c8a561 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.524903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:38.525342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 804/1594] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 23 23:20:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:20:38.526249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:38.530171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.531121 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.531396 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.550658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:38.551906 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:38.564087 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 805/1595] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:38.577589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:38.587705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74cb08-b845-4f4a-816f-f2c2788f581c None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:38.591786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:38.592417 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.592695 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.592994 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.604457 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:38.606240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf1c45-e348-4a23-a35b-3901a6a1fbe0 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:38.606755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 791/1596] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Aug 23 23:20:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:38.614900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:38.627572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3251a93-764e-44aa-85f7-c144053f098b None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:38.634024 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:38.634672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:38.634961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:38.635239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:38.635975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 806/1597] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:38.637577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:38.651498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:38.653253 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:38.665256 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 792/1598] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:20:40.645772 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13781f-89f5-492c-bd8a-ae3c32bd52ee None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:40.646252 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13781f-89f5-492c-bd8a-ae3c32bd52ee None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:40.646338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13781f-89f5-492c-bd8a-ae3c32bd52ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:40.666340 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5f13781f-89f5-492c-bd8a-ae3c32bd52ee None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:40.667492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5f13781f-89f5-492c-bd8a-ae3c32bd52ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:40.674805 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 807/1599] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:40.688377 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:40.700752 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b3bd-0da9-464e-8e19-454d62f457cc service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:40.706498 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:40.707227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:40.707583 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:40.707975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:40.717900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:40.719600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:40.733195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 793/1600] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:20:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:20:49.070843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9da-a325-40b7-8410-dc88b7c7a699 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:49.071314 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9da-a325-40b7-8410-dc88b7c7a699 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:49.071715 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348f9da-a325-40b7-8410-dc88b7c7a699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:49.091014 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7348f9da-a325-40b7-8410-dc88b7c7a699 None None] MFA Rules not processed for user `e8335dd9c12b44f885d60cff8f59e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:49.092251 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7348f9da-a325-40b7-8410-dc88b7c7a699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:49.099570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 808/1601] 10.222.0.57 () {58 vars in 1015 bytes} [Tue Aug 23 23:20:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:49.117574 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:49.127114 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261349e-5f7f-410e-8904-65f1170cfce6 service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:49.131007 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:49.131613 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:49.132511 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:49.132850 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:49.140806 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:49.142227 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c58500-bf68-457c-9801-995a144aa54c service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:49.152736 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 794/1602] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:49.827659 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad7d1-d26a-4ba8-b3d9-70debd9c0675 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:49.828148 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad7d1-d26a-4ba8-b3d9-70debd9c0675 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:49.828596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ad7d1-d26a-4ba8-b3d9-70debd9c0675 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:49.830448 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 809/1603] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:20:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:49.898803 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1528-03cb-45f9-af34-4b0b28dbd8f5 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:49.899103 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1528-03cb-45f9-af34-4b0b28dbd8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:49.899383 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a1528-03cb-45f9-af34-4b0b28dbd8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:49.923641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-998a1528-03cb-45f9-af34-4b0b28dbd8f5 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:49.925160 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-998a1528-03cb-45f9-af34-4b0b28dbd8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:49.937733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 795/1604] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:20:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:20:49.953328 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ad7d1-d26a-4ba8-b3d9-70debd9c0675 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:49.968741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ad7d1-d26a-4ba8-b3d9-70debd9c0675 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:49.974490 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:49.975104 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:49.975385 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:49.976259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:49.986159 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:49.987774 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f20cc6-3af8-4f87-a192-ae8d65233c2f service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:49.999779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 810/1605] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:20:56.069118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b226-0869-4f68-9373-1f04099d3dfd None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:56.070699 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b226-0869-4f68-9373-1f04099d3dfd None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:56.071137 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99b226-0869-4f68-9373-1f04099d3dfd None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:56.073257 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 796/1606] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:20:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:20:56.080873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:56.081520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:56.081520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:56.102368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:20:56.103770 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:20:56.113116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 811/1607] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:20:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:20:56.131525 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99b226-0869-4f68-9373-1f04099d3dfd None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:20:56.145497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99b226-0869-4f68-9373-1f04099d3dfd None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:20:56.150989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:20:56.151594 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:20:56.151912 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:20:56.152241 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:20:56.161186 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:20:56.162758 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c456e763-6036-4b58-9234-153be3a118d5 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:20:56.173503 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 797/1608] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:20:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:21:06.097079 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=76 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:06.169425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=91 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:15.360730 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:21:15.370011 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aadc5f9-73a3-4142-8ba7-8012d9d37444 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:21:15.373702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:21:15.374312 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:15.374596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:15.374877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:15.384150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:21:15.385595 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da1815-1219-4d9d-9d4c-94044d13d415 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:21:15.395674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 812/1609] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:21:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:21:20.284634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869cf0-f987-42b9-959e-fa94d677c559 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:21:20.285192 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869cf0-f987-42b9-959e-fa94d677c559 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:21:20.285375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62869cf0-f987-42b9-959e-fa94d677c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:21:20.304873 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-62869cf0-f987-42b9-959e-fa94d677c559 None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:21:20.306092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-62869cf0-f987-42b9-959e-fa94d677c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:21:20.313640 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 798/1610] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:21:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:21:25.391462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:21:30.299779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:04.884602 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:04.885229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:04.885229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:04.907229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:04.908501 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:04.916075 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 813/1611] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:22:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:14.901555 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:22.259944 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c9a2-cc14-4c40-8ec1-30ba2afe4173 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:22.260459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c9a2-cc14-4c40-8ec1-30ba2afe4173 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:22.260561 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2c9a2-cc14-4c40-8ec1-30ba2afe4173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:22.281123 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-d4e2c9a2-cc14-4c40-8ec1-30ba2afe4173 None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:22.282412 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d4e2c9a2-cc14-4c40-8ec1-30ba2afe4173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:22.289577 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 799/1612] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:22:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:22.331948 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:22.343658 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5829763-f34f-42e4-8dce-33eef8a0158d None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:22.348779 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:22.349386 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:22.349666 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:22.349939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:22.358191 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:22.359836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83cdb95-521d-444c-8d9a-77cb6259036f service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:22.367822 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 814/1613] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:22:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:22:25.700843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:25.701862 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:25.702072 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:25.721672 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:25.722877 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:25.729743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 800/1614] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:22:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:26.039978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a6382-07b0-4866-af0b-cd6d3e10ff95 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:26.040466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a6382-07b0-4866-af0b-cd6d3e10ff95 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:26.040556 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a6382-07b0-4866-af0b-cd6d3e10ff95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:26.059280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-4d6a6382-07b0-4866-af0b-cd6d3e10ff95 None None] MFA Rules not processed for user `e8335dd9c12b44f885d60cff8f59e55a`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:26.061057 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-4d6a6382-07b0-4866-af0b-cd6d3e10ff95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:26.067627 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 815/1615] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:22:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:26.079975 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:26.089548 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19aebb63-0f74-4198-8688-482960dfd0e1 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:26.093113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:26.093710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:26.093992 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:26.094267 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:26.101358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:26.102790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:26.110799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 801/1616] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:22:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:22:36.054674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:36.107175 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=12 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:22:56.875108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800197c2-0ec2-471c-ab0b-a5782c57631e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:56.875626 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800197c2-0ec2-471c-ab0b-a5782c57631e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:56.875913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800197c2-0ec2-471c-ab0b-a5782c57631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:56.895776 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-800197c2-0ec2-471c-ab0b-a5782c57631e None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:22:56.897063 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-800197c2-0ec2-471c-ab0b-a5782c57631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:22:56.904337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 816/1617] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 23 23:22:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:22:56.917783 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:22:56.929851 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206640c-5786-4496-833b-7767a2b70153 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:22:56.934820 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:22:56.935422 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:22:56.935705 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:22:56.936019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:22:56.944907 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:22:56.946415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:22:56.955446 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 802/1618] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:22:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:23:06.891076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:06.951310 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:12.641091 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497da5-6060-4def-a351-9440e8e8e037 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:12.641596 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497da5-6060-4def-a351-9440e8e8e037 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:12.641702 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98497da5-6060-4def-a351-9440e8e8e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:12.661985 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-98497da5-6060-4def-a351-9440e8e8e037 None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:12.663205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-98497da5-6060-4def-a351-9440e8e8e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:12.670111 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 817/1619] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:23:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:22.656619 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:27.782742 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:27.792265 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbc754-88a7-41f1-adc6-a3642699f90d service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:27.796051 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:27.796656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:27.796938 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:27.797213 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:27.806746 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:27.808250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e070a6-8acc-413c-89d0-c50e12d47935 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:27.818687 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 803/1620] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:23:29.926642 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41bbf5-b6e8-4556-a992-b78bd1b99596 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:29.927219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41bbf5-b6e8-4556-a992-b78bd1b99596 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:29.927219 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41bbf5-b6e8-4556-a992-b78bd1b99596 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:29.928647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 818/1621] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:23:29.934336 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:29.934798 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:29.934894 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:29.954760 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] MFA Rules not processed for user `6aee1815f27f44e5a738eda3234595e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:23:29.956108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:23:29.965458 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 804/1622] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:23:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:23:29.979250 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41bbf5-b6e8-4556-a992-b78bd1b99596 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:23:29.994843 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41bbf5-b6e8-4556-a992-b78bd1b99596 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:23:30.000214 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:23:30.000874 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:23:30.001162 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:23:30.001437 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:23:30.011474 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:23:30.013118 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe0706-54fe-4671-a6de-f75f93753ac0 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:23:30.023845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 819/1623] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:23:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:23:39.949893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=9 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:23:40.019362 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:36.474807 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:36.491297 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc24c6f-50fd-4e5a-a266-7c682b1815d4 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:36.503709 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:36.504706 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:36.505147 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:36.505606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:36.519629 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:36.522733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:36.543892 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 805/1624] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:24:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:24:37.496347 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fe0f-008a-4ec4-ae04-679da20e7826 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:37.496903 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fe0f-008a-4ec4-ae04-679da20e7826 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:37.497520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0fe0f-008a-4ec4-ae04-679da20e7826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:37.523470 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-5fc0fe0f-008a-4ec4-ae04-679da20e7826 None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:37.525077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-5fc0fe0f-008a-4ec4-ae04-679da20e7826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:37.535002 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 820/1625] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 23 23:24:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:37.610204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:37.628834 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296ab2d-8eac-4036-85c7-17864311ed0a service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:37.636669 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:37.637311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:37.637604 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:37.637876 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:37.649053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:37.651093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:37.661337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 806/1626] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:24:38.423482 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09236-d991-4eac-af34-e6c40e8ddcae None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.423951 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09236-d991-4eac-af34-e6c40e8ddcae None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.424372 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd09236-d991-4eac-af34-e6c40e8ddcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.456212 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-acd09236-d991-4eac-af34-e6c40e8ddcae None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:38.458164 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-acd09236-d991-4eac-af34-e6c40e8ddcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:38.473177 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 821/1627] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:24:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:38.490291 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:38.502496 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5540da3-9d97-489d-9a4b-8f8d22a048ce service swift] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:38.508893 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:38.509570 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:38.509954 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:38.510236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:38.521161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:38.522786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfa75a-7982-40ef-9e7c-5dec118724f1 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:38.537785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 807/1628] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:24:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:24:48.448865 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:48.530921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=18 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:24:49.778456 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:49.779342 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:49.779491 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:49.814025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] MFA Rules not processed for user `c6ce435ca5a4421baafe1d249d908df1`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:49.817565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:49.831313 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 822/1629] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:24:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:24:52.852631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:52.853394 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:52.853557 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:52.890537 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:24:52.892358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:24:52.915108 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 808/1630] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 23 23:24:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:24:52.936393 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:24:52.961334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70cc92e-c555-408d-8264-1809fc136a4e None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:24:52.970703 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:24:52.972366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:24:52.972732 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:24:52.973092 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:24:52.986420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:24:52.990205 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59ba65a-d1fc-43c2-b7b2-6cd6d1960ce1 service swift] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:24:53.006734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 823/1631] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:24:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:25:02.882781 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=3 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:02.999236 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:27.547978 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:27.568143 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea4374-5096-4fae-b6b5-b8bbc47598bb None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:27.575204 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:27.576073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:27.576430 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:27.576780 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:27.586707 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:27.588346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:27.598420 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 809/1632] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:32.498754 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:32.499334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:32.499334 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:32.526228 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:25:32.527411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:25:32.536373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 824/1633] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:25:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:25:37.593358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=6 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:38.778472 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:38.789151 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de9a5d-a353-46c4-b211-be80cf2fe6d7 service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:38.793480 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:38.794239 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:38.794698 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:38.795171 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:38.807451 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:38.808980 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:38.822864 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 810/1634] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:40.019158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:40.028959 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4715d2-e437-4a88-831d-781db0fad47b None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:40.033240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:40.034078 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:40.034364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:40.034639 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:40.047076 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:40.049735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:40.061993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 825/1635] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:44.406591 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:44.419610 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9fcbc4-85cc-4072-a8c0-4c743061a135 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:44.426335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d040be-05a0-418a-9b20-756274549fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:44.426961 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d040be-05a0-418a-9b20-756274549fff service nova] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:44.427240 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d040be-05a0-418a-9b20-756274549fff service nova] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:44.427513 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d040be-05a0-418a-9b20-756274549fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:44.436299 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d040be-05a0-418a-9b20-756274549fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:44.438041 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d040be-05a0-418a-9b20-756274549fff service nova] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:44.451467 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 811/1636] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:50.056494 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=9 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:25:52.010308 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:52.025053 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd67f5-6550-4182-be96-de93e6cb49ee service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:52.034976 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:52.035778 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:52.036145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:52.036497 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:52.059378 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:52.062062 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d9a2b-e699-4f1d-8719-54be80161a88 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:52.081958 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 826/1637] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:25:52.229767 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d040be-05a0-418a-9b20-756274549fff service nova] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:25:52.243869 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d040be-05a0-418a-9b20-756274549fff service nova] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:25:52.248952 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:25:52.250006 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:25:52.250520 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:25:52.251077 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:25:52.264015 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:25:52.267163 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:25:52.283896 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 812/1638] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:25:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:02.073600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=6 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:02.276194 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=18 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:38.550628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:38.551411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:38.551411 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:38.572900 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] MFA Rules not processed for user `3eb0da545f0548649d8f9c191dd03fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:38.574517 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:38.582025 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 827/1639] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 23 23:26:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:26:38.624217 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:38.637158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfffb20-bc76-4fde-a175-a9c99a650265 service neutron] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:38.642756 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '528934c45fb140dea3dc59f2056fcd5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:38.643366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:38.643651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:38.643957 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:38.652953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:38.654550 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc9ad0-538f-4c8b-b7bc-07b94e625b65 service swift] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:38.663484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 813/1640] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 23 23:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 23 23:26:39.025492 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:39.035584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f82503-e460-47fa-837f-0cc0b6863ac7 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:39.042371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:39.042988 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:39.044786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:39.044786 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:39.111529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:39.113113 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48636cfd-2d8b-425b-b420-e07fdbe14cf5 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:39.123606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 828/1641] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:43.108070 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957fa45-1f96-4790-a76e-2adb4ab2d476 None None] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:43.108647 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957fa45-1f96-4790-a76e-2adb4ab2d476 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:43.108739 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957fa45-1f96-4790-a76e-2adb4ab2d476 None None] PATH_INFO: `/` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:43.110278 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 814/1642] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 23 23:26:43.124846 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab1b1-6a75-4a29-bf51-4d4721225a87 None None] REQUEST_METHOD: `POST` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:43.125427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab1b1-6a75-4a29-bf51-4d4721225a87 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:43.125518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ab1b1-6a75-4a29-bf51-4d4721225a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:43.147195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.auth.core [None req-d94ab1b1-6a75-4a29-bf51-4d4721225a87 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81584) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:43.148453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-d94ab1b1-6a75-4a29-bf51-4d4721225a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:43.157281 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 829/1643] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:26:43.203589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957fa45-1f96-4790-a76e-2adb4ab2d476 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:43.219749 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957fa45-1f96-4790-a76e-2adb4ab2d476 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:43.225453 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:43.226085 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:43.226373 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:43.226649 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:43.246425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:43.248335 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae1e5cb-46e9-441e-9dde-ff7de62e2f5a service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:43.261188 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 815/1644] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:46.605922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f86a3-9915-4939-9e87-7def41582cd6 None None] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:46.606427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f86a3-9915-4939-9e87-7def41582cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:46.606755 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f86a3-9915-4939-9e87-7def41582cd6 None None] PATH_INFO: `/` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:46.609723 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 830/1645] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 23 23:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 23 23:26:46.617459 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:46.617947 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:46.618037 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:46.643093 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] MFA Rules not processed for user `2e7d7805d7c64a6aa65cca2b9b32c94f`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:26:46.644358 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:46.653768 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 816/1646] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 23 23:26:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 23 23:26:46.669058 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f86a3-9915-4939-9e87-7def41582cd6 None None] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:46.686716 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:46.687589 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f86a3-9915-4939-9e87-7def41582cd6 None None] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:46.693634 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:46.694674 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:46.695185 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:46.695681 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:46.704275 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a4ced5-d484-4993-a150-563aa9407701 None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:46.706419 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:46.708927 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:46.710638 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:46.711286 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:46.711620 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:46.712181 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] PATH_INFO: `/v3/users/c6ce435ca5a4421baafe1d249d908df1` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:46.713407 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ce435ca5a4421baafe1d249d908df1)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:46.714685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: WARNING py.warnings [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:46.714685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: warnings.warn(msg) Aug 23 23:26:46.714685 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: Aug 23 23:26:46.716628 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:46.719799 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 831/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:26:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:26:46.794466 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ce435ca5a4421baafe1d249d908df1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:46.795158 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ce435ca5a4421baafe1d249d908df1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:46.815073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ce435ca5a4421baafe1d249d908df1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:46.824019 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ce435ca5a4421baafe1d249d908df1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:46.836395 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ce435ca5a4421baafe1d249d908df1'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:46.842652 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 817/1648] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 23 23:26:46 2022] DELETE /identity/v3/users/c6ce435ca5a4421baafe1d249d908df1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:47.025484 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:47.037201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c86409-77a6-4749-bce0-0969eca93e89 service placement] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:47.103950 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:47.104597 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:47.104882 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:47.105161 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] PATH_INFO: `/v3/projects/40c55d7810214bb6a453afb56a9453ca` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:47.106296 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c55d7810214bb6a453afb56a9453ca)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:47.107323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: WARNING py.warnings [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 23 23:26:47.107323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: warnings.warn(msg) Aug 23 23:26:47.107323 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: Aug 23 23:26:47.108735 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:47.167441 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c55d7810214bb6a453afb56a9453ca', 'request_id': 'req-9e61c690-b7a7-4b8b-9782-81a510869d38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.177802 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c55d7810214bb6a453afb56a9453ca', 'request_id': 'req-9e61c690-b7a7-4b8b-9782-81a510869d38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.186930 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c55d7810214bb6a453afb56a9453ca', 'request_id': 'req-9e61c690-b7a7-4b8b-9782-81a510869d38'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.202142 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:47.208845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] The token cache is being invalidate because project 40c55d7810214bb6a453afb56a9453ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:26:47.209277 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.210234 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.212777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 832/1649] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 23 23:26:47 2022] DELETE /identity/v3/projects/40c55d7810214bb6a453afb56a9453ca => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:47.216914 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:47.218368 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:47.232067 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4021b7f-7571-4df9-8239-d37b720ffb7b admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:47.295388 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:47.296074 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:47.296357 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:47.296636 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] PATH_INFO: `/v3/users/62128bf69e8b4c368775fce8fde40570` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:47.297793 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62128bf69e8b4c368775fce8fde40570)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:47.299745 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:47.348657 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:47.356895 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62128bf69e8b4c368775fce8fde40570'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.357710 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62128bf69e8b4c368775fce8fde40570'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.371510 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62128bf69e8b4c368775fce8fde40570'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.380488 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62128bf69e8b4c368775fce8fde40570'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.388145 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-12cf4517-fb0c-4fd7-af77-841456181b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62128bf69e8b4c368775fce8fde40570'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.394572 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 818/1650] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 23 23:26:47 2022] DELETE /identity/v3/users/62128bf69e8b4c368775fce8fde40570 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:47.595581 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:26:47.597415 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:26:47.619155 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61c690-b7a7-4b8b-9782-81a510869d38 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:26:47.695337 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:26:47.696028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:26:47.696311 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:26:47.696586 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] PATH_INFO: `/v3/projects/f0e8cca97e7a4130a00591e157dab06b` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:26:47.697724 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e8cca97e7a4130a00591e157dab06b)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:26:47.699664 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:26:47.747923 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e8cca97e7a4130a00591e157dab06b', 'request_id': 'req-3f288424-5ac6-430c-9a8d-5174102e0337'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.756845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e8cca97e7a4130a00591e157dab06b', 'request_id': 'req-3f288424-5ac6-430c-9a8d-5174102e0337'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.762743 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e8cca97e7a4130a00591e157dab06b', 'request_id': 'req-3f288424-5ac6-430c-9a8d-5174102e0337'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.775539 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] The token cache is being invalidate because project f0e8cca97e7a4130a00591e157dab06b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:26:47.775852 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.776535 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:26:47.778088 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 833/1651] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 23 23:26:47 2022] DELETE /identity/v3/projects/f0e8cca97e7a4130a00591e157dab06b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:26:57.390714 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=14,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:26:57.772193 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:37.333008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] REQUEST_METHOD: `POST` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:37.333641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:37.333641 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:37.358195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.auth.core [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] MFA Rules not processed for user `6c9d2e88818b4c758d438f85659a0ada`. Rule list: `[]` (Enabled: `True`). {{(pid=81583) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 23 23:27:37.359464 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:37.440443 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 819/1652] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 23 23:27:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 23 23:27:37.920319 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:37.922128 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:38.016863 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f288424-5ac6-430c-9a8d-5174102e0337 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:38.021562 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:38.022655 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:38.022968 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:38.023260 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:38.028442 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:38.049029 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:38.050663 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:38.064201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 834/1653] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:27:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:27:39.676150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:39.678242 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:39.759890 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244b48ec-cc2f-4309-b5bf-14ecfcd4ccad None None] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:39.770356 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:39.771150 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:39.772073 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:39.772365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:39.775182 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:39.788763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:39.790427 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:39.805609 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 820/1654] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:27:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:27:48.058584 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=26 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:49.799936 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=57 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:27:55.144249 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:27:55.150375 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:55.252195 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2259a-222d-42b5-8d8e-23f7a1f1f008 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:27:55.259922 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aee1815f27f44e5a738eda3234595e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:27:55.260600 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:27:55.260792 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:27:55.260999 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:27:55.262838 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:27:55.276447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:27:55.278198 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:27:55.290993 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 835/1655] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:27:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:28:05.285116 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=34 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:36.643592 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:36.764218 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a721d872-122a-4e5f-ab91-f173933f0e5f service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:36.770364 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e7d7805d7c64a6aa65cca2b9b32c94f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:36.771651 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] REQUEST_METHOD: `GET` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:36.772140 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:36.772606 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:36.774913 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:36.823366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:36.825033 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:36.836631 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 821/1656] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 23 23:29:46.414763 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:46.468028 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abc80-f25c-46e2-8472-e50778295347 service nova] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:46.472202 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8335dd9c12b44f885d60cff8f59e55a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd41dd42fe9954e0c909af16dd06fd264', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:46.472836 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] REQUEST_METHOD: `GET` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:46.473119 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:46.473401 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:46.475454 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:46.588301 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:46.589932 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:46.618469 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 836/1657] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 23 23:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 23 23:29:46.831447 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=36 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:54.232829 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:54.234518 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:54.251031 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dcdd2d-439e-4a7b-9d43-6a4bbd4bf9a1 service placement] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:54.257008 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:54.257425 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:54.257989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:54.257989 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] PATH_INFO: `/v3/users/6c9d2e88818b4c758d438f85659a0ada` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:54.259183 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c9d2e88818b4c758d438f85659a0ada)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:54.261165 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:54.321845 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c9d2e88818b4c758d438f85659a0ada'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.322565 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c9d2e88818b4c758d438f85659a0ada'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.337785 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c9d2e88818b4c758d438f85659a0ada'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.355921 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c9d2e88818b4c758d438f85659a0ada'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.363733 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c9d2e88818b4c758d438f85659a0ada'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.372618 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 822/1658] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 23 23:29:54 2022] DELETE /identity/v3/users/6c9d2e88818b4c758d438f85659a0ada => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 23 23:29:54.571460 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:54.587529 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e9b5-ed99-4dd3-b9bc-b5020a9cb187 service neutron] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:54.663777 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:54.664365 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:54.664656 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:54.664939 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] PATH_INFO: `/v3/projects/dae066ec7ed7493cb7b1001057ab1396` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:54.666220 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae066ec7ed7493cb7b1001057ab1396)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:54.668280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:54.719696 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:54.728366 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae066ec7ed7493cb7b1001057ab1396', 'request_id': 'req-73443392-da29-4fcd-9c4d-fc96a0d3be77'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.739338 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae066ec7ed7493cb7b1001057ab1396', 'request_id': 'req-73443392-da29-4fcd-9c4d-fc96a0d3be77'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.747169 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae066ec7ed7493cb7b1001057ab1396', 'request_id': 'req-73443392-da29-4fcd-9c4d-fc96a0d3be77'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.759973 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] The token cache is being invalidate because project dae066ec7ed7493cb7b1001057ab1396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:29:54.760268 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.760953 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.762495 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 837/1659] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 23 23:29:54 2022] DELETE /identity/v3/projects/dae066ec7ed7493cb7b1001057ab1396 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:29:54.767068 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Authenticating user token {{(pid=81583) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:54.768790 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.fernet_utils [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81583) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:54.784130 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f162b3-a5e5-47f6-b9cc-49f382041c94 admin admin] Validating token access rules against request {{(pid=81583) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:54.849476 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81583) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:54.850124 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:54.850400 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:54.850676 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] PATH_INFO: `/v3/users/d8fbdddc1a9347fea65232549cd3239f` {{(pid=81583) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:54.851886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fbdddc1a9347fea65232549cd3239f)` {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:54.853828 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] RBAC: Authorization granted {{(pid=81583) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:54.914886 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fbdddc1a9347fea65232549cd3239f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.915949 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fbdddc1a9347fea65232549cd3239f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.934797 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fbdddc1a9347fea65232549cd3239f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.946259 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fbdddc1a9347fea65232549cd3239f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.949280 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:29:54.956110 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG keystone.notifications [None req-8fd946b5-2fa8-4773-b025-42dfac969b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fbdddc1a9347fea65232549cd3239f'} {{(pid=81583) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:54.970661 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: [pid: 81583|app: 0|req: 823/1660] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 23 23:29:54 2022] DELETE /identity/v3/users/d8fbdddc1a9347fea65232549cd3239f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:29:55.204804 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Authenticating user token {{(pid=81584) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 23 23:29:55.206680 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.fernet_utils [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81584) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 23 23:29:55.229741 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73443392-da29-4fcd-9c4d-fc96a0d3be77 admin admin] Validating token access rules against request {{(pid=81584) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 23 23:29:55.300675 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0ca15452b034174ab0e683ef8b23043', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2adca37f0d3413e86c54f533079bbbf', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81584) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 23 23:29:55.301229 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 23 23:29:55.302098 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] SCRIPT_NAME: `/identity` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 23 23:29:55.302346 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] PATH_INFO: `/v3/projects/2b126e245f2e4f4698e2a2cf688f0620` {{(pid=81584) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 23 23:29:55.303823 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b126e245f2e4f4698e2a2cf688f0620)` {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 23 23:29:55.306082 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] RBAC: Authorization granted {{(pid=81584) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 23 23:29:55.359348 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b126e245f2e4f4698e2a2cf688f0620', 'request_id': 'req-12402229-bfdc-4c57-8bff-2aa0762d703f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:55.369462 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b126e245f2e4f4698e2a2cf688f0620', 'request_id': 'req-12402229-bfdc-4c57-8bff-2aa0762d703f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:55.375734 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b126e245f2e4f4698e2a2cf688f0620', 'request_id': 'req-12402229-bfdc-4c57-8bff-2aa0762d703f'} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:55.388410 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] The token cache is being invalidate because project 2b126e245f2e4f4698e2a2cf688f0620 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81584) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 23 23:29:55.388690 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:55.389371 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG keystone.notifications [None req-12402229-bfdc-4c57-8bff-2aa0762d703f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81584) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 23 23:29:55.390880 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: [pid: 81584|app: 0|req: 838/1661] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 23 23:29:55 2022] DELETE /identity/v3/projects/2b126e245f2e4f4698e2a2cf688f0620 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 23 23:30:04.964201 dv-osbrick-853457-3-iscsi devstack@keystone.service[81583]: DEBUG dbcounter [-] [81583] Writing DB stats keystone:SELECT=4 {{(pid=81583) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 23:30:05.385084 dv-osbrick-853457-3-iscsi devstack@keystone.service[81584]: DEBUG dbcounter [-] [81584] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81584) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}